logo
avatarLog in
中文
Algorithm Engineering Track
Competition Status已结束
Total Prize¥ 230000

Track Introductionspecial-title-icon

This is the Algorithm Engineering track of the 2023 Tencent AI Arena Artificial Intelligence National Open Competition, a custom competition developed in collaboration with Tencent AI Arena Platform and Vivo. It is exclusively open to invited teams from colleges, universities, and research institutes.

Rewardsspecial-title-icon

Prize amounts are in RMB (pre-tax).

Engineering Track (total prize money: 230,000 RMB)

Champion: Prize Money 100,000 RMB + Competition Certificate + Trophy

Runner-up: Prize Money 50,000 RMB + Competition Certificate + Trophy

Third Place: Prize Money 30,000 RMB + Competition Certificate + Trophy

Excellence Award (4th-8th place): Prize Money 10,000 RMB + Competition Certificate

Other Rewards

In addition to the prize money, participating teams can also receive the following rewards:

1.Completion of the race (successful submission of models and verification of passing) will result in an official certificate of participation.

2.Outstanding participants will have the opportunity to obtain internship opportunities for relevant positions offered by Tencent AI Arena Program and Vivo, as well as Tencent Group campus recruitment and internship recruitment green channel qualifications. Details will be announced later.

3.The outstanding teams will be invited to participate in the Tencent STAC.

Schedule
Time period: September to November
This competition is based on simulated business scenarios, requiring teams to build and optimize a mobile deployment solution for AI agent models. The focus is on assessing the usability and inferential performance of the model.
Honor of Kings 3v3
Scenario Type: Battle Test + Mobile Performance Test
Map: Changping Map
Lineup: To be announced
Number of agents: 3
Evaluation Method: During the match, utilize the designated evaluation tool to independently verify and evaluate in the local environment. At the end of the competition, submit the required documents for evaluation to the platform, and the platform will conduct a unified evaluation and run the list. Submit the original project source code and technical report documents at the end of the competition.
Computational Resources: Each team will receive an equal amount of GPU computing power provided by the platform and iQOO mobile terminals provided by Vivo during the competition period.

Description: This stage utilizes the Honor of Kings 3v3 Changping Map. In addition to the main elongated lane, the map includes an upper and a lower jungle area. At each end of the map are the revival points for each team's agents, with the team's crystal located in front of the revival point. The crystal continuously produces minions for its team, which automatically advance towards the enemy's camp, attacking enemy towers, crystals, and heroes along the way. In front of the crystal is the team's defense towers, capable of attacking enemy heroes and minions entering its range. The jungle area is a primary source of economic and experience gains for jungler heroes. Players from both teams share the entire jungle area, although some entrances to the jungle are team-restricted. Agents can freely move and use skills within the map. Over time, agents gain gold and experience, with significant rewards for killing jungle monsters, enemy minions, enemy heroes, or destroying enemy towers. The team that successfully destroys the opponent's crystal wins the match.

Task Objective: Complete the adaptation and end-to-end deployment of the baseline model within the specified time. On the basis of ensuring the availability of the deployment model meets the standards, optimize the various inference performance indicators of the model running on designated iQOO mobile devices. Specific indicators are detailed in the following text.

Evaluation method: Conduct battle testing and performance testing on deployment models (divided into Linux battle packages and mobile deployment packages).

● Battle Test: The Linux battle package submitted by the participating teams and the reference model provided by Tencent AI Arena platform are used for multi round battles. In each round of the match, both models compete according to the test lineup combination and match each other's lineup combination one by one. Each combination switches sides and plays 2 rounds. After the battle is completed, calculate the victory rate based on the number of wins/total number of matches submitted in the model.

The participating teams need to ensure that the calculation results of the same test input processed by the submitted Linux battle package have an error smaller than a certain threshold compared to the mobile version. Otherwise, the submitted model will be deemed invalid and the test will fail.

● Performance testing:The platform regularly conducts batch testing on the mobile deployment packages submitted by each participating team, collects running results and performance data through multiple runs, and serves as a scoring basis.

Evaluation indicators
A usability standard is set for the deployment models submitted by participating teams. Once this standard is met, performance scores can be calculated.

●  Usability standard
    ○   Baseline capability inheritance: Complete battle testing, deploy models against reference models, with a win rate of no less than 40%
    ○   Stability: Completed performance testing, deployed the model to run stably multiple times, without memory exceptions or crashes
●  Mobile inference performance
    ○  Calculate the comprehensive performance score based on the data collected in the performance test
    ○  Scoring sub-items (weighted by a certain proportion)
      ■  Time consumption - The mobile inference time consumption of the deployed model
      ■  Size - The mobile storage overhead of the deployed model
      ■  Memory - The device memory overhead during deployment model runtime
      ■  Power consumption - The device power consumption level during deployment model runtime

For any further registration inquiries, please join the Q&A QQ group with the number 732115106