Speech Emotion Recognition in Naturalistic Conditions Challenge

Interspeech 2025: Speech Emotion Recognition Challenge

Speech Emotion Recognition in Naturalistic Conditions Challenge Overview

We are glad to invite you to participate in the Speech Emotion Recognition in Naturalistic Conditions Challenge at Interspeech 2025 to compare different emotion recognition systems submitted by teams all around the world. The challenge uses recordings from the MSP-Podcast corpus, which contains speech segments obtained from audio-sharing websites. The speaking turns have been perceptually annotated by at least five raters with categorical and attribute-based emotional labels.

The Tasks

The challenge consists of two independent tasks. Each team can participate in one or both:

  • Task 1 - Categorical emotion recognition: Classification across the eight emotional classes provided: anger, happiness, sadness, fear, surprise, contempt, disgust, and neutral state. The test set for the challenge has a balanced distribution across the emotional categories.
  • Task 2 - Emotional attribute prediction: Prediction of the emotional attributes for arousal (calm to active), valence (negative to positive), and dominance (weak to strong). The emotional attributes are annotated with continuous values between 1 and 7 for each dimension.

Participants are encouraged to improve upon the baseline system by exploring innovative approaches, including but not limited to advanced machine learning techniques, novel feature representations, and multi-modal analyses.

The Rules

Teams must register by completing and submitting the provided academic license agreement to msp-lab@utdallas.edu. Each institution must have its own signed license agreement. If you already have a license of a previous version of the MSP-Podcast corpus, you only need to request the challenge version.

Data Usage: Participants are only allowed to use the provided MSP-Podcast corpus datasets for training and development. Other publicly available pre-trained generalistic models (wav2vec, Hubert, etc) are allowed. However, the use of pre-trained models specifically trained on emotion recognition tasks is not allowed. The use of additional datasets for training is prohibited to ensure fairness.

Submissions must follow the specified file format (.csv) and be made through the designated submission platform.

Winners will be decided based on their score on the leaderboard and also on the quality of the submitted paper. The winning team(s) will receive a certificate from the challenge organizers.

Disqualification: Teams found to have violated the rules, such as using prohibited data or submitting under multiple team names, will be disqualified.

Important dates

  • Submission to Leaderboard Deadline: January 31st, 2025
  • Teams will be allowed one submission per week per task. Submission reset on Sunday.
  • Challenge Paper Deadline: 12 February 2025 (Same as a regular Interspeech paper deadline)
  • Winner Announcement: during Interspeech 2025.
Organizers: Carlos Busso, Berrak Sisman, Najim Dehak, İsmail Rasim Ülgen, Lucas Goncalves, Abinay Reddy Naini, Ali N. Salman, Pravin Mote, Thomas Thebaud, Laureano Moro Velázquez, Paola Garcia.

Submission Instructions

Before submission, please read and follow the instructions carefully.
Only registered team submissions will be accepts. To register please visit the overview tab.
For information about baselines visit this link.
Each registered email is permitted a maximum of one submission per week per task. For the first submission, participants may choose any preferred team name. However, it is important to use the same team name for subsequent submissions, as any different name will result in rejection.

The submission portal will open on December 9th, 2024 and close on January 31st, 2025 (AOE).

Task 1: Categorical

  • The categorical letters must be {A, C, D, F, H, N, S, U}, Any other letter will not be accepted
  • A=Anger, C= Contempt, D= Disgust, F= Fear, H= Happiness, N= Neutral, S= Sadness, U= Surprise
  • Metric: Macro-F1 score
  • Example submission file:
  • FileName, EmoClass
    MSP-PODCAST_test3_0001.wav, S
    MSP-PODCAST_test3_0002.wav, D
    MSP-PODCAST_test3_0003.wav, A
    MSP-PODCAST_test3_0004.wav, U
    ...
  • Sample file

Task 2: Attributes

  • The values are from 1 to 7:
    • Arousal (1 calm, 7 active)
    • Valence (1 negative, 7 positive)
    • Dominance (1 weak, 7 strong)
  • Values outside this range will create an error
  • Metric: average of Concordance Correlation Coefficient (CCC)
  • Example submission file:
  • FileName, EmoAct, EmoVal, EmoDom
    MSP-PODCAST_test3_0001.wav, 5.962445394, 1.645595285, 3.277091995
    MSP-PODCAST_test3_0002.wav, 5.925202743, 3.510046627, 4.902689017
    MSP-PODCAST_test3_0003.wav, 5.133939009, 2.012986747, 5.79230556
    MSP-PODCAST_test3_0004.wav, 2.727285967, 4.033873751, 1.566529833
    ...
  • Sample file
Emotion Recognition Challenge

Submission Form

Congratulations to all teams in the Speech Emotion Recognition in Naturalistic Conditions Challenge! We're thrilled to announce that the submission portal is now closed. Thank you for your valuable contributions, and best of luck as we move to the next evaluation phase.
Team NameF1 MacroF1 MicroAccuracySubmissionDate
NTUA0.43160.43190.431942025-01-31 20:43:03
SAIL0.42810.44030.440362025-02-01 04:31:33
SAIL0.42740.44030.440352025-01-25 07:44:21
ABHINAYA0.41810.42690.426962025-01-29 00:29:38
ABHINAYA0.4180.42660.426672025-02-01 04:50:40
Voinosis0.41010.40970.409752025-01-31 15:23:53
UNICAMP0.40940.41280.412862025-01-28 06:22:04
NTUA0.40580.41130.411332025-01-21 17:31:30
Voinosis0.40570.40750.407542025-01-30 15:59:09
SAIL0.40440.42130.421342025-01-18 21:16:38
UNICAMP0.40410.40750.407552025-01-22 20:28:23
UNICAMP0.40360.41090.410942025-01-13 20:55:36
NU0.40330.41840.418432025-01-19 20:42:12
NTUA0.40260.41190.411912025-01-05 11:37:46
BSC-UPC0.40060.40720.407262025-02-01 06:41:34
SAIL0.39860.41560.415632025-01-10 14:30:37
Goias0.39790.41410.414142025-01-30 23:51:51
Goias0.39790.41410.414152025-01-30 23:51:54
Voinosis0.39750.39750.397532025-01-25 02:03:11
NU0.39420.40530.405322025-01-13 04:15:47
NTUA0.3940.40810.408122025-01-12 15:02:23
BSC-UPC0.39370.40030.400352025-01-31 16:23:23
NU0.38820.40160.401642025-01-30 09:17:57
NU0.38740.39160.391612025-01-06 13:13:27
UNICAMP0.38520.39870.398732025-01-06 10:56:35
Voinosis0.37840.38250.382522025-01-18 04:01:58
SRPOL0.37840.39840.398422025-01-31 11:26:47
USTC0.3780.3950.39522025-01-22 22:30:18
SAIL0.37710.38940.389412024-12-28 07:31:29
BSC-UPC0.37580.38780.387832025-01-18 11:22:43
Goias0.37550.40250.402532025-01-22 17:58:31
cheryfs0.37540.39220.392252025-01-12 21:38:57
BSC-UPC0.37460.38620.386222025-01-11 12:55:19
BSC-UPC0.37430.39030.390342025-01-25 08:36:07
Sheffield0.37020.40250.402522025-01-26 09:16:36
iiitd0.36610.37940.379432025-01-18 00:58:28
CEA-LIST0.36490.37030.370312025-02-01 06:49:16
SAIL0.36290.38310.383122025-01-04 19:19:01
Volta0.36130.36530.365362025-01-31 07:47:46
SRPOL0.36110.38030.380312025-01-26 16:07:43
tmu-ml0.35690.37030.370332025-01-30 17:49:47
Fosafer0.35490.36750.367552025-01-22 02:35:41
ABHINAYA0.35340.38720.387252025-01-25 04:20:42
Echo0.35160.35690.356922025-01-20 02:20:30
Volta0.35160.35690.356952025-01-20 02:20:39
Fosafer0.3510.37060.370662025-01-26 22:39:27
PRML_SPT0.35080.37690.376932025-01-25 04:17:37
ABHINAYA0.35040.36940.369442025-01-16 08:43:37
NTUST0.3470.36560.365612025-01-07 02:48:59
aluminumbox0.34550.36130.361342025-02-01 04:34:13
PRML_SPT0.34550.36250.362552025-02-01 04:59:33
Echo0.34510.34940.349412025-01-15 03:34:20
Sheffield0.34410.37870.378712025-01-06 05:24:26
NeuralThinkers RGUKT RKV0.3410.36160.361632025-01-25 12:54:47
HYU_ASML0.34050.36340.363442025-01-19 21:41:12
UNICAMP0.34030.36660.366622025-01-01 15:08:04
cheryfs0.33980.36060.360612024-12-19 23:25:17
LangSpeech0.33880.36310.363162025-01-30 15:53:28
PRML_SPT0.33840.3650.36542025-01-28 23:15:07
Fosafer0.33820.360.3642025-01-13 00:21:27
LangSpeech0.33640.36190.361952025-01-24 12:31:48
LangSpeech0.33450.36030.360332025-01-06 15:52:42
PRML_SPT0.33440.36160.361622025-01-12 05:04:34
KT0.33430.35970.359712024-12-26 22:43:34
biic0.33210.35940.359422025-01-12 04:11:49
NTUST0.33130.35940.359422025-01-14 13:28:01
T_MERG0.33130.35780.357812025-01-18 04:23:38
cheryfs0.33130.35660.356662025-01-22 21:42:44
GAULab0.33090.36630.366312024-12-27 01:22:01
ABHINAYA0.330.36410.364132025-01-10 09:11:19
NeuralThinkers RGUKT RKV0.32950.35060.350612025-01-10 09:11:27
Baseline0.32930.35560.355612024-12-08 16:20:31
iiitd0.32930.35530.355322025-01-07 23:35:41
KT0.32490.35440.354422025-01-02 05:26:35
Goias0.32410.33970.339722025-01-12 23:55:22
LangSpeech0.32230.35780.357842025-01-15 23:52:41
KT0.3210.35780.357852025-01-31 20:41:38
NTUST0.32070.3450.34542025-01-30 20:30:55
NTUST0.32060.32780.327832025-01-21 20:42:29
NeuralThinkers RGUKT RKV0.32050.34590.345942025-01-31 06:43:31
Goias0.32020.35720.357212025-01-06 12:42:33
KT0.31950.35470.354742025-01-23 03:12:01
cityu0.31860.33310.333112024-12-27 11:48:34
AstroSpeech0.31820.34880.348842025-01-25 07:38:18
iscas0.31550.36060.360612025-01-06 01:53:15
iiitd0.31530.35090.350962025-01-31 09:09:59
biic0.31330.34440.344432025-01-19 00:09:35
Volta0.31240.34780.347812024-12-20 07:43:31
nyu0.31140.320.3222025-02-01 02:10:48
AstroSpeech0.3110.34910.349152025-02-01 05:44:06
AstroSpeech0.30720.34310.343162025-02-01 05:45:33
AstroSpeech0.30570.31940.319412024-12-22 11:23:02
biic0.30460.32370.323712024-12-30 06:30:20
biic0.30430.34220.342242025-01-26 06:29:57
cheryfs0.30420.35310.353122024-12-25 22:29:36
BSC-UPC0.30250.34190.341912025-01-05 05:20:15
KT0.30220.34750.347532025-01-12 11:32:11
nyu0.3020.32120.321212025-02-01 00:05:13
Voinosis0.29820.33560.335612025-01-11 04:18:43
ABHINAYA0.2970.31810.318112024-12-22 23:25:20
SERenade0.29660.31590.315912025-01-26 05:51:45
ABHINAYA0.29350.34380.343822024-12-30 09:57:22
Fosafer0.29230.33840.338422024-12-29 23:09:28
tmu-ml0.2910.30970.309712025-01-11 09:05:28
AstroSpeech0.28860.31530.315312024-12-30 09:39:32
cheryfs0.28650.32370.323742025-01-03 17:00:34
NU0.28640.33560.335652025-01-31 03:19:53
USTC0.28570.32120.321212025-01-13 00:33:39
UNICAMP0.28370.32030.320312024-12-20 05:43:39
AstroSpeech0.27970.31220.312232025-01-18 15:15:13
Volta0.27460.29380.293872025-01-31 10:35:44
Echo0.27460.29380.293832025-01-31 10:36:18
NeuralThinkers RGUKT RKV0.27180.30220.302222025-01-12 20:02:10
iiitd0.27140.33030.330352025-01-30 23:29:52
tmu-ml0.26910.29840.298422025-01-19 22:35:28
SEU_AIPLab0.26880.31720.317212024-12-20 22:55:49
ZZZXMTKG0.26660.29160.291612024-12-26 23:21:33
AstroSpeech0.26520.30380.303822025-01-11 13:35:33
LangSpeech0.26310.29840.298412024-12-26 17:35:16
Volta0.2630.2950.29532025-01-11 06:16:03
Volta0.25850.27340.273442025-01-19 06:51:31
IRIT/MFU0.25770.30090.300912025-01-24 10:58:33
SEU_AIPLab0.24950.31130.311332025-01-04 02:26:49
iiitd0.24930.30250.302542025-01-25 01:08:23
iscas0.24850.31940.319422025-01-23 23:21:55
iscas0.2480.28280.282832025-02-01 05:12:50
IRIT/MFU0.24660.29410.294122025-01-31 03:43:35
cheryfs0.23980.27810.278132024-12-29 21:37:41
aluminumbox0.23330.27720.277232025-01-26 04:01:09
NTNU0.21760.24970.249712025-01-26 03:46:25
Hishoo0.21530.26310.263112025-01-26 13:52:04
ZZZXMTKG0.21120.29190.291932025-01-25 10:40:51
iitrpr0.2110.25970.259722025-01-31 07:40:17
aluminumbox0.20870.28780.287822025-01-19 04:50:41
ZZZXMTKG0.19930.29440.294442025-01-31 21:07:35
Volta0.19480.28660.286622025-01-04 06:22:28
AIMAC0.19160.23310.233132025-01-31 15:37:49
SERenade0.19110.28750.287522025-02-01 06:16:48
PRML_SPT0.18530.280.2812025-01-04 01:30:27
Fosafer0.1850.26440.264432025-01-07 05:21:12
iiitd0.17640.23530.235312024-12-31 22:33:27
HDU-FXF0.17280.25250.252522025-01-13 00:11:09
ZZZXMTKG0.17070.23660.236622025-01-13 08:15:25
intema.ai0.16930.18410.184112025-01-18 08:16:35
intema.ai0.16690.21910.219122025-01-25 06:22:11
cityu0.16490.25560.255632025-01-05 10:58:02
HDU-FXF0.16130.24340.243412025-01-09 21:32:01
aluminumbox0.15550.2250.22512025-01-07 02:19:40
AIMAC0.15490.21410.214122025-01-31 14:00:38
shri0.14550.23910.239112025-01-25 10:07:45
shri0.14530.20780.207822025-02-01 06:48:30
shri0.14530.20780.207832025-02-01 06:48:33
UC3M0.13260.22440.224422025-01-31 06:41:18
Fosafer0.12930.19030.190312024-12-23 21:28:38
Hishoo0.12910.20910.209122025-01-31 15:54:55
AIMAC0.1290.21280.212812025-01-23 14:53:54
HYU_ASML0.110.13660.136612024-12-28 00:47:50
LangSpeech0.10830.13250.132522024-12-30 00:09:00
UC3M0.10780.16560.165612025-01-19 04:36:36
HYU_ASML0.10160.13560.135622025-01-01 01:30:35
HYU_ASML0.10160.13560.135632025-01-08 04:52:32
HDU-FXF0.09380.1050.10532025-01-20 10:13:12
SEU_AIPLab0.08840.12370.123722024-12-28 23:04:20
cityu0.06560.09030.090322025-01-01 11:41:17
Moratuwa0.06290.15720.157212025-01-26 05:35:17
iitrpr0.05850.13440.134412025-01-25 12:46:00
team_namef1_macrof1_microaccuracysubmissionNumdate
Team NameValenceArousalDominanceAverageSubmissionDate
SAIL0.68290.6420.4980.607642025-01-26 04:26:41
SAIL0.67940.6340.48780.600452025-02-01 01:13:11
SRPOL0.69320.6320.47550.600332025-02-01 02:16:54
SEU_AIPLab0.67090.62420.49140.595562025-01-30 15:57:28
Voinosis0.69410.61190.47220.592852025-01-31 18:20:08
SEU_AIPLab0.66510.62310.48170.5952025-01-26 08:34:45
SEU_AIPLab0.67050.62280.47490.589442025-01-19 07:48:05
SRPOL0.69060.61870.45470.58822025-01-31 07:47:11
ABHINAYA0.66710.62180.47250.587152025-01-23 06:19:34
PRML_SPT0.65470.61930.48270.585622025-01-25 00:59:16
biic0.67340.60690.47530.585222025-01-12 00:56:32
ABHINAYA0.66710.61360.47250.584462025-01-29 12:28:52
PRML_SPT0.64610.61530.48930.583642025-01-30 10:16:30
ABHINAYA0.66710.62180.45930.582722024-12-31 13:45:26
PRML_SPT0.64980.61550.48060.58232025-01-27 08:07:56
LangSpeech0.64410.62290.47690.581332025-01-26 10:04:37
Voinosis0.67590.61190.45520.58132025-01-25 23:36:39
T_MERG0.66270.60120.47860.580822025-01-26 09:39:59
IoTTP0.65520.62150.46510.580632025-02-01 04:28:43
ABHINAYA0.65580.61290.47250.580442025-01-16 08:13:56
Baseline0.63850.62320.47750.579712024-12-08 16:21:58
Echo0.63850.62320.47750.579722025-01-31 10:30:13
Echo0.63790.62290.47690.579212025-01-21 22:17:23
ZZZXMTKG0.64240.61590.47370.577312025-01-25 10:55:37
biic0.69530.59110.44460.57732025-01-18 22:20:54
Voinosis0.69410.59830.4380.576842025-01-31 12:00:36
biic0.6880.59870.44270.576542025-01-26 05:54:02
cheryfs0.6450.61380.46660.575112024-12-24 22:15:18
IoTTP0.62970.6140.48120.57512024-12-30 08:52:53
UNICAMP0.59710.63580.49180.574912024-12-20 05:53:31
IoTTP0.64010.62670.45770.574822025-02-01 03:03:06
SRPOL0.68720.60160.42950.572812025-01-24 12:24:08
T_MERG0.66120.60430.45180.572412025-01-18 04:18:53
aluminumbox0.65330.61060.45260.572132025-02-01 04:12:12
cheryfs0.65910.60910.44780.57252025-01-30 09:40:50
LangSpeech0.64410.6150.45270.570612025-01-10 16:31:37
iiitd0.64470.60510.45890.569612025-01-08 03:05:16
Voinosis0.65460.60160.45150.569222025-01-17 20:21:56
KT0.62830.61680.46220.569112025-01-02 05:30:51
SAIL0.60990.61890.47360.567522025-01-11 17:00:49
IoTTP0.63460.60540.46110.56712024-12-24 09:50:44
UBA0.64440.59150.4650.56742025-01-19 10:00:48
NTUST0.64560.60380.45030.566622025-01-15 07:30:08
SEU_AIPLab0.60740.61360.47360.564932025-01-12 07:41:49
SEU_AIPLab0.64430.60240.44740.564712024-12-21 06:19:59
NTUST0.65080.60270.43650.563332025-01-28 23:23:18
KT0.64330.60650.4390.562932025-01-23 03:12:08
iiitd0.58960.62270.47490.562432025-01-31 00:04:17
DFKI_SLT0.62760.6310.42250.560432025-02-01 04:31:56
USTC0.64130.5980.43870.559332025-01-29 10:20:10
PRML_SPT0.62490.61160.43950.558712025-01-18 01:24:08
cheryfs0.62930.60350.44020.557732025-01-12 21:05:00
KT0.6380.59910.42990.555722025-01-18 08:28:33
KT0.64940.60220.41450.555342025-01-31 20:39:26
SEU_AIPLab0.670.5840.41160.555222024-12-29 00:00:24
DFKI_SLT0.61620.6310.41650.554622025-01-31 11:39:30
UBA0.65540.58810.41510.552922025-01-03 18:43:22
AstroSpeech0.67870.57410.40490.552652025-01-24 09:44:50
AstroSpeech0.68110.57480.40090.552362025-02-01 03:33:43
UNICAMP0.61070.59880.44430.551322025-01-03 17:00:41
USTC0.60880.60250.44050.550612025-01-14 09:45:06
AstroSpeech0.67050.57230.4070.5532025-01-10 09:53:40
SAIL0.60790.59340.44790.549732025-01-19 02:06:25
UBA0.64910.58390.41460.549252025-02-01 00:44:06
Volta0.63920.58750.41420.546922025-01-30 16:00:36
iiitd0.5430.620.4740.545722025-01-18 00:57:36
biic0.59770.59570.430.541252025-02-01 06:04:20
NTUA0.68570.55180.37630.537922025-01-30 19:31:03
ABHINAYA0.62080.56290.40930.53112024-12-27 01:18:53
AstroSpeech0.65430.55430.38350.530742025-01-18 14:24:52
MLCLAB0.58170.59310.41350.529422025-01-31 01:59:46
USTC0.57420.58890.42110.528122025-01-21 01:34:01
ABHINAYA0.62330.55970.40050.527832025-01-07 07:18:19
NTUA0.66050.54250.37480.525912025-01-12 18:27:18
UBA0.52360.59150.43670.517332025-01-12 17:38:44
SAIL0.53390.59920.41320.515512025-01-04 18:13:49
IRIT/MFU0.57030.57960.3870.512342025-01-24 11:00:00
DFKI_SLT0.56690.59890.37020.51212025-01-25 17:28:17
iiitd0.58330.55480.39750.511942025-01-31 00:10:30
biic0.60240.56330.36580.510512024-12-30 06:32:05
UBA0.48780.59250.45070.510312024-12-26 15:47:17
LangSpeech0.54350.56930.41530.509422025-01-22 13:15:37
tmu-ml0.57990.53920.40290.507432025-01-30 17:45:23
cheryfs0.54940.56190.40530.505522024-12-29 21:16:47
IRIT/MFU0.58730.5470.3790.504432025-01-13 09:01:55
MLCLAB0.57430.54670.36670.495912025-01-30 23:30:48
Voinosis0.59560.51940.35640.490412025-01-11 04:35:52
AstroSpeech0.56530.55140.35260.489722025-01-04 02:20:44
IRIT/MFU0.50840.56240.38540.485452025-01-31 04:55:38
Volta0.59080.51810.33210.480312025-01-20 20:02:58
tmu-ml0.56940.49990.36220.477222025-01-19 22:55:09
aluminumbox0.42740.54570.33710.436822025-01-18 08:02:14
Hishoo0.40710.51980.30250.409812025-01-26 11:02:14
NTUST0.27860.55510.39540.409712025-01-07 03:58:17
AIMAC0.19130.55590.39510.380742025-01-31 15:40:40
AIMAC0.24980.53720.34130.376122025-01-23 14:57:50
AIMAC0.14770.55430.37660.359532025-01-31 14:06:12
intema.ai0.23920.49730.32150.352722025-01-25 06:22:34
tmu-ml0.51070.32670.20570.347712025-01-11 09:05:50
aluminumbox0.17020.46570.33310.32312025-01-07 02:36:37
intema.ai0.1270.48920.30240.306212025-01-18 08:18:04
SERenade0.54830.20190.12950.293212025-01-26 05:24:34
AstroSpeech0.55280.18750.11430.284912024-12-22 12:47:04
ABHINAYA0.66710.01980.01120.232772025-01-31 09:32:43
cheryfs-0.00130.58890.02570.204442025-01-21 00:33:10
IRIT/MFU0.00740.03070.3870.141712024-12-28 12:14:32
IRIT/MFU0.00740.03070.3870.141722025-01-08 10:08:44
Hishoo-0.05740.0420.22170.068722025-02-01 04:19:15
LABIA-0.01490.07270.0250.027612025-01-31 19:11:12
LABIA-0.02430.05990.00030.011922025-01-31 20:05:10
AIMAC0.0006-0.00430.01160.002612025-01-07 10:07:28
team_nameValenceArousalDominanceAveragesubmissionNumdate
Interspeech 2025 Challenge FAQ

FAQs - Interspeech 2025 Challenge

Registering

Do all team members need a license?
Yes, every institution should have a license.

Should the license be signed?
Yes, at the end of the third page.

Is sending unpublished papers to UTD required?
No, you do not need to send papers to UTD. Check attachment 2 of the license agreement for details.

Use of SSL models

Use of public models like wav2vec?
General audio representations are allowed, but models trained specifically for emotion are not.

Use of ASR models for transcripts?
Yes, ASR models can be used to obtain transcripts.

Can we use pre-trained text generative models like ChatGPT?
Yes.

Data and labels

Use of additional proprietary data?
No, for fairness.

Use of additional datasets?
No, you cannot use other publicly available datasets.

Can we annotate provided data with additional labels?
No, gender is included so it can be used, but no new labels can be added.

Submission and Baseline

What metrics will be used?
Macro-F1 score for task 1, and concordance correlation coefficient (CCC) for task 2.

What is the file format for submission?
Submissions must be in .csv format, detailed in the submission section of the website.

Will we have access to the leaderboard during submission?
Yes, the leaderboard will update shortly after each submission.

Is there an official baseline?
Yes, details are available on this GitHub page.