# NLLB T4 Product-Name Tuning

- Generated at: `2026-03-19T00:26:01`
- Python: `3.12.3`
- Torch: `2.10.0+cu128`
- Transformers: `5.3.0`
- CUDA: `True`
- GPU: `Tesla T4` (15.56 GiB)

## Scope

- Bulk scenario: `batch=64, concurrency=1`
- Online scenario: `batch=1, concurrency=64`
- Online requests per worker: `24`
- Quality spot-check samples: `100`

## Variants

- `ct2_default_fixed64`: Original CT2 default -> `{'ct2_inter_threads': 1, 'ct2_max_queued_batches': 0, 'ct2_batch_type': 'examples', 'max_new_tokens': 64}`
- `ct2_prev_t4_fixed64`: Previous T4 tuning result -> `{'ct2_inter_threads': 2, 'ct2_max_queued_batches': 16, 'ct2_batch_type': 'examples', 'max_new_tokens': 64}`
- `ct2_best_t4_dynamic`: Recommended T4 profile after this round -> `{'ct2_inter_threads': 4, 'ct2_max_queued_batches': 32, 'ct2_batch_type': 'examples', 'max_new_tokens': 64, 'ct2_decoding_length_mode': 'source', 'ct2_decoding_length_extra': 8, 'ct2_decoding_length_min': 32}`
- `ct2_fixed48_experiment`: High-gain experiment with truncation risk -> `{'ct2_inter_threads': 3, 'ct2_max_queued_batches': 16, 'ct2_batch_type': 'examples', 'max_new_tokens': 48}`

## nllb zh->en

| Variant | Bulk items/s | Bulk p95 ms | Online items/s | Online p95 ms | Quality same/total |
|---|---:|---:|---:|---:|---:|
| ct2_default_fixed64 | 122.32 | 585.0 | 13.2 | 1671.15 | 90/100 |
| ct2_prev_t4_fixed64 | 121.98 | 586.75 | 15.96 | 1397.45 | 90/100 |
| ct2_best_t4_dynamic | 120.53 | 598.72 | 16.97 | 1354.49 | 89/100 |
| ct2_fixed48_experiment | 130.99 | 523.66 | 16.56 | 1336.85 | 89/100 |

### Quality Notes: ct2_default_fixed64

- Input: `男士偏光飞行员太阳镜`
- Candidate: `The male pilot's sunglasses are illuminated by male particle light.`
- Reference: `The male pilot's sunglasses are illuminated by male particle reflection.`

- Input: `成人亨利危险连帽衫超级英雄Cosplay服装`
- Candidate: `Adult Henry dangerous hat superheroes in cosplay outfit`
- Reference: `Adult Henry dangerous hat superheroes in cosplay costumes`

- Input: `Devoko 30加仑树脂甲板储物箱`
- Candidate: `Devoko 30加 resin decoction storage box`
- Reference: `Devoko 30 plus resin decoction container is used.`


### Quality Notes: ct2_prev_t4_fixed64

- Input: `男士偏光飞行员太阳镜`
- Candidate: `The male pilot's sunglasses are illuminated by male particle light.`
- Reference: `The male pilot's sunglasses are illuminated by male particle reflection.`

- Input: `成人亨利危险连帽衫超级英雄Cosplay服装`
- Candidate: `Adult Henry dangerous hat superheroes in cosplay outfit`
- Reference: `Adult Henry dangerous hat superheroes in cosplay costumes`

- Input: `Devoko 30加仑树脂甲板储物箱`
- Candidate: `Devoko 30加 resin decoction storage box`
- Reference: `Devoko 30 plus resin decoction container is used.`


### Quality Notes: ct2_best_t4_dynamic

- Input: `男士偏光飞行员太阳镜`
- Candidate: `The male pilot's sunglasses are illuminated by male particle light.`
- Reference: `The male pilot's sunglasses are illuminated by male particle reflection.`

- Input: `成人亨利危险连帽衫超级英雄Cosplay服装`
- Candidate: `Adult Henry dangerous hat superheroes in cosplay outfit`
- Reference: `Adult Henry dangerous hat superheroes in cosplay costumes`

- Input: `Devoko 30加仑树脂甲板储物箱`
- Candidate: `Devoko 30加 resin decoction storage box`
- Reference: `Devoko 30 plus resin decoction container is used.`


### Quality Notes: ct2_fixed48_experiment

- Input: `男士偏光飞行员太阳镜`
- Candidate: `The male pilot's sunglasses are illuminated by male particle light.`
- Reference: `The male pilot's sunglasses are illuminated by male particle reflection.`

- Input: `成人亨利危险连帽衫超级英雄Cosplay服装`
- Candidate: `Adult Henry dangerous hat superheroes in cosplay outfit`
- Reference: `Adult Henry dangerous hat superheroes in cosplay costumes`

- Input: `Devoko 30加仑树脂甲板储物箱`
- Candidate: `Devoko 30加 resin decoction storage box`
- Reference: `Devoko 30 plus resin decoction container is used.`


## nllb en->zh

| Variant | Bulk items/s | Bulk p95 ms | Online items/s | Online p95 ms | Quality same/total |
|---|---:|---:|---:|---:|---:|
| ct2_default_fixed64 | 96.19 | 699.29 | 6.44 | 3552.29 | 90/100 |
| ct2_prev_t4_fixed64 | 95.38 | 704.22 | 7.94 | 2923.52 | 90/100 |
| ct2_best_t4_dynamic | 94.64 | 710.35 | 8.6 | 2742.66 | 84/100 |
| ct2_fixed48_experiment | 110.49 | 605.15 | 8.49 | 2772.75 | 70/100 |

### Quality Notes: ct2_default_fixed64

- Input: `MAIHUN Women Teacher Life Shirt Teacher Gift Short Sleeve Shirts It s a Beautiful Day for Learning T-Shirt`
- Candidate: `马女教师生活衫教师礼物短袖衫这是学习T恤的美丽的一天`
- Reference: `马女教师生活衫教师礼物短袖衫这是学习T-shirt的美丽的一天`

- Input: `Squishmallows Original 16-Inch Carpio Teal Scorpion - Large Ultrasoft Official Jazwares Plush`
- Candidate: `鱼原始16英寸的卡皮奥茶叶鱼 - 大型超软官方Jazwares Plush`
- Reference: `鱼原始16英寸的卡皮奥茶叶鱼 - 大超软官方Jazwares Plush`

- Input: `NARMO 925 Sterling Silver Hoop Earrings Heart Hoop Earings for Women U Shaped Hoop Earrings Colorful Cubic Zirconia Large Big Hoops Various Hypoallergenic Hoop Earrings`
- Candidate: `米925 银胡耳环 女子心胡耳环 U 形状胡耳环 色彩式立方圆 巨型大胡 各种异常过敏性胡耳环`
- Reference: `米925 银胡耳环 妇女心胡耳环 U 形状胡耳环 色彩式立方圆 大大胡 各种异常过敏性胡耳环`


### Quality Notes: ct2_prev_t4_fixed64

- Input: `MAIHUN Women Teacher Life Shirt Teacher Gift Short Sleeve Shirts It s a Beautiful Day for Learning T-Shirt`
- Candidate: `马女教师生活衫教师礼物短袖衫这是学习T恤的美丽的一天`
- Reference: `马女教师生活衫教师礼物短袖衫这是学习T-shirt的美丽的一天`

- Input: `Squishmallows Original 16-Inch Carpio Teal Scorpion - Large Ultrasoft Official Jazwares Plush`
- Candidate: `鱼原始16英寸的卡皮奥茶叶鱼 - 大型超软官方Jazwares Plush`
- Reference: `鱼原始16英寸的卡皮奥茶叶鱼 - 大超软官方Jazwares Plush`

- Input: `NARMO 925 Sterling Silver Hoop Earrings Heart Hoop Earings for Women U Shaped Hoop Earrings Colorful Cubic Zirconia Large Big Hoops Various Hypoallergenic Hoop Earrings`
- Candidate: `米925 银胡耳环 女子心胡耳环 U 形状胡耳环 色彩式立方圆 巨型大胡 各种异常过敏性胡耳环`
- Reference: `米925 银胡耳环 妇女心胡耳环 U 形状胡耳环 色彩式立方圆 大大胡 各种异常过敏性胡耳环`


### Quality Notes: ct2_best_t4_dynamic

- Input: `Sunglasses Men Polarized Aviator Sunglasses for Men Women Fishing Driving Sun glasses Metal Frame UV400 Protection`
- Candidate: `阳光眼镜 男人聚合式飞行员 阳光眼镜 男人 女人 捕鱼 驾驶 阳光眼镜 金属框架`
- Reference: `阳光眼镜 男人聚合式飞行员 阳光眼镜 男人 女人 捕鱼 驾驶 阳光眼镜 金属框架 UV400 保护`

- Input: `MAIHUN Women Teacher Life Shirt Teacher Gift Short Sleeve Shirts It s a Beautiful Day for Learning T-Shirt`
- Candidate: `马女教师生活衫教师礼物短袖衫这是学习T恤的美丽的一天`
- Reference: `马女教师生活衫教师礼物短袖衫这是学习T-shirt的美丽的一天`

- Input: `Squishmallows Original 16-Inch Carpio Teal Scorpion - Large Ultrasoft Official Jazwares Plush`
- Candidate: `鱼原始16英寸的卡皮奥茶叶鱼 - 大型超软官方Jazwares Plush`
- Reference: `鱼原始16英寸的卡皮奥茶叶鱼 - 大超软官方Jazwares Plush`


### Quality Notes: ct2_fixed48_experiment

- Input: `Hillban 10 Pcs Christmas Makeup Bags Gifts for Women Bulk Xmas Cosmetic Bags Inspirational Christian Bible Verse Cosmetic Pouch Christmas Religious Church Travel Canvas Pouch(Classic,White)`
- Candidate: `希尔班10件制品圣诞化袋礼物妇女批量Xmas化袋 灵感基督教圣经诗 化袋圣诞宗教教堂旅行帆布袋 (古典`
- Reference: `希尔班10件制品圣诞化袋礼物妇女批量Xmas化袋 灵感基督教圣经诗 化袋圣诞宗教教堂旅行帆布袋 (古典,白色)`

- Input: `MAIHUN Women Teacher Life Shirt Teacher Gift Short Sleeve Shirts It s a Beautiful Day for Learning T-Shirt`
- Candidate: `马女教师生活衫教师礼物短袖衫这是学习T恤的美丽的一天`
- Reference: `马女教师生活衫教师礼物短袖衫这是学习T-shirt的美丽的一天`

- Input: `Devoko 30 Gallon Resin Deck Box Waterproof Outdoor Storage Box for Patio Furniture Pool Accessories Indoor Storage for Cushion Garden Tools (30 Gallon, Black)`
- Candidate: `德沃科30树脂甲板盒子防水室外储存盒子,用于室家具池具配件,用于式花园工具的室内储存 (30,黑色`
- Reference: `德沃科30树脂甲板盒子防水室外储存盒子,用于室家具池具配件,用于式花园工具的室内储存 (30,黑色)`
