ai-saas / saas-search

Commit d6c29734fb60593cb213c50a565d559dea845542

Authored by tangwang
1 parent 822ab0fd

translation optimize: 

1. deepl performance improve
2. nllb-200-distilled-600m model params optimize
Showing 8 changed files with 3037 additions and 55 deletions   Show diff stats
Inline Side-by-side
artifacts/search_evaluation/datasets/core_queries/batch_reports/batch_20260417T124503Z_fa7b4d165a/queries.txt 0 → 100644
  Show/Hide comments   View file @d6c2973
... ... @@ -0,0 +1,54 @@
  1 +白色oversized T-shirt
  2 +falda negra oficina
  3 +red fitted tee
  4 +黒いミディ丈スカート
  5 +黑色中长半身裙
  6 +فستان أسود متوسط الطول
  7 +чёрное летнее платье
  8 +修身牛仔裤
  9 +date night dress
  10 +vacation outfit dress
  11 +minimalist top
  12 +streetwear t-shirt
  13 +office casual blouse
  14 +波西米亚花朵衬衫
  15 +泡泡袖短袖
  16 +扎染字母T恤
  17 +V-Neck Cotton T-shirt
  18 +Athletic Gym T-shirt
  19 +Plus Size Loose T-shirt
  20 +Korean Style Slim T-shirt
  21 +Basic Layering Top
  22 +shawl collar cardigan
  23 +swim dress
  24 +毕业典礼定制西装
  25 +colorblock hoodie
  26 +sock boots
  27 +旅行服装
  28 +khaki green backpack
  29 +皱边裙
  30 +高跟鞋
  31 +图案连身衣
  32 +天鹅绒鸡尾酒会礼服
  33 +gingham dress
  34 +海滩度假装
  35 +vacation outfits
  36 +running shorts
  37 +pink sweater aesthetic
  38 +hiking boots
  39 +宽松开襟羊毛衫
  40 +business casual women
  41 +a-line dress
  42 +涤纶短裤
  43 +Compression Top Spandex
  44 +skiing trip insulated base layer
  45 +high waisted jeans
  46 +无袖夏装
  47 +雪纺衬衫
  48 +convertible zip-off hiking pants
  49 +petite summer linen shorts
  50 +tall slim fit men's linen shirt
  51 +tall slim fit trousers
  52 +tall straight leg pants
  53 +tassel maxi skirt
  54 +teacher clothes
... ...
artifacts/search_evaluation/datasets/core_queries/batch_reports/batch_20260417T124503Z_fa7b4d165a/report.md 0 → 100644
  Show/Hide comments   View file @d6c2973
... ... @@ -0,0 +1,2760 @@
  1 +# Search Batch Evaluation
  2 +
  3 +- Batch ID: batch_20260417T124503Z_fa7b4d165a
  4 +- Created at: 2026-04-17T12:45:03.610288+00:00
  5 +- Tenant ID: 163
  6 +- Query count: 54
  7 +- Top K: 100
  8 +
  9 +## Dataset
  10 +
  11 +- Dataset ID: core_queries
  12 +- Display Name: Core Queries
  13 +- Query File: /data/saas-search/scripts/evaluation/queries/queries.txt
  14 +- Query Count: 54
  15 +- Query SHA1: cd66bfac8a3cc50aedd4aeca38407fd17e04a2cf
  16 +
  17 +## Aggregate Metrics
  18 +
  19 +- Primary metric: Primary_Metric_Score
  20 +- Gain scheme (NDCG): {'Fully Relevant': 3, 'Mostly Relevant': 2, 'Weakly Relevant': 1, 'Irrelevant': 0}
  21 +- Stop probabilities (ERR): {'Fully Relevant': 0.875, 'Mostly Relevant': 0.375, 'Weakly Relevant': 0.125, 'Irrelevant': 0.0}
  22 +
  23 +- Primary_Metric_Score: 0.617835
  24 +- NDCG@20: 0.706475
  25 +- NDCG@50: 0.669601
  26 +- ERR@10: 0.736439
  27 +- Strong_Precision@10: 0.668519
  28 +- Strong_Precision@20: 0.598148
  29 +- Useful_Precision@50: 0.816667
  30 +- Avg_Grade@10: 2.037037
  31 +- Gain_Recall@20: 0.06782
  32 +- ERR@10: 0.736439
  33 +- ERR@20: 0.739731
  34 +- ERR@5: 0.727252
  35 +- ERR@50: 0.739908
  36 +- Exact_Precision@10: 0.494444
  37 +- Exact_Precision@20: 0.437037
  38 +- Exact_Precision@5: 0.548148
  39 +- Exact_Success@10: 0.796296
  40 +- Exact_Success@5: 0.759259
  41 +- Gain_Recall@10: 0.04189
  42 +- Gain_Recall@50: 0.133139
  43 +- MRR_Exact@10: 0.681864
  44 +- MRR_Strong@10: 0.832922
  45 +- NDCG@10: 0.744503
  46 +- NDCG@5: 0.767436
  47 +- Strong_Precision@5: 0.7
  48 +- Strong_Success@10: 0.944444
  49 +- Strong_Success@5: 0.888889
  50 +- Useful_Precision@10: 0.874074
  51 +- Useful_Precision@20: 0.849074
  52 +
  53 +## Label Distribution
  54 +
  55 +- Fully Relevant: 1429
  56 +- Mostly Relevant: 891
  57 +- Weakly Relevant: 1780
  58 +- Irrelevant: 1300
  59 +
  60 +## Per Query
  61 +
  62 +### 白色oversized T-shirt
  63 +
  64 +- Primary_Metric_Score: 0.535485
  65 +- NDCG@20: 0.556574
  66 +- NDCG@50: 0.543856
  67 +- ERR@10: 0.388784
  68 +- Strong_Precision@10: 0.7
  69 +- Strong_Precision@20: 0.65
  70 +- Useful_Precision@50: 0.78
  71 +- Avg_Grade@10: 1.9
  72 +- Gain_Recall@20: 0.031334
  73 +- ERR@10: 0.388784
  74 +- ERR@20: 0.388785
  75 +- ERR@5: 0.38859
  76 +- ERR@50: 0.388785
  77 +- Exact_Precision@10: 0.5
  78 +- Exact_Precision@20: 0.4
  79 +- Exact_Precision@5: 0.6
  80 +- Exact_Success@10: 1.0
  81 +- Exact_Success@5: 1.0
  82 +- Gain_Recall@10: 0.01701
  83 +- Gain_Recall@50: 0.070725
  84 +- MRR_Exact@10: 0.333333
  85 +- MRR_Strong@10: 0.5
  86 +- NDCG@10: 0.569619
  87 +- NDCG@5: 0.589511
  88 +- Strong_Precision@5: 0.8
  89 +- Strong_Success@10: 1.0
  90 +- Strong_Success@5: 1.0
  91 +- Useful_Precision@10: 0.7
  92 +- Useful_Precision@20: 0.7
  93 +- Fully Relevant: 17
  94 +- Mostly Relevant: 31
  95 +- Weakly Relevant: 32
  96 +- Irrelevant: 20
  97 +- Request ID: `80011511`
  98 +- Top-10 Labels: `1:L0 | 2:L2 | 3:L3 | 4:L3 | 5:L3 | 6:L3 | 7:L0 | 8:L0 | 9:L3 | 10:L2`
  99 +- Top-20 Labels: `1:L0 | 2:L2 | 3:L3 | 4:L3 | 5:L3 | 6:L3 | 7:L0 | 8:L0 | 9:L3 | 10:L2 | 11:L2 | 12:L2 | 13:L1 | 14:L0 | 15:L3 | 16:L0 | 17:L2 | 18:L3 | 19:L3 | 20:L0`
  100 +- Case Snapshot:
  101 + - #1 [L0] spu=61708 Women Oversized T-Shirt Summer Casual Short Sleeve Loose Tee Tops (rel=116.232666)
  102 + zh: 女式夏季宽松休闲短袖衬衫上衣
  103 + - #2 [L2] spu=64795 Pro Club Men's Heavyweight Cotton Short Sleeve Crew Neck T-Shirt, White, 10X-Large (rel=154.13132)
  104 + zh: Pro Club 男款加厚纯棉短袖圆领T恤，白色，10XL
  105 + - #3 [L3] spu=61803 Women's Oversize Workout Crop Tops Casual Short Sleeve Drop Shoulder Boxy T-Shirts Roll Hem Basic Loose Yoga Running Tees (rel=90.03993)
  106 + zh: 女式宽松运动短袖吊带衫 休闲落肩廓形基础款瑜伽跑步T恤 罗纹下摆
  107 + - #4 [L3] spu=62911 Women's Oversize Workout Crop Tops Casual Short Sleeve Drop Shoulder Boxy T-Shirts Roll Hem Basic Loose Yoga Running Tees (rel=85.09979)
  108 + zh: 女式宽松运动短袖吊带衫 休闲落肩廓形基础款瑜伽跑步T恤 罗纹下摆
  109 + - #5 [L3] spu=63760 Fisoew Women's Oversized T Shirts Tees Half Sleeve Crew Neck Cotton Tunic Tops (rel=97.215416)
  110 + zh: Fisoew 女士宽松短袖圆领纯棉长款上衣
  111 +
  112 +### falda negra oficina
  113 +
  114 +- Primary_Metric_Score: 0.295428
  115 +- NDCG@20: 0.341513
  116 +- NDCG@50: 0.392191
  117 +- ERR@10: 0.204636
  118 +- Strong_Precision@10: 0.1
  119 +- Strong_Precision@20: 0.25
  120 +- Useful_Precision@50: 0.74
  121 +- Avg_Grade@10: 0.9
  122 +- Gain_Recall@20: 0.035088
  123 +- ERR@10: 0.204636
  124 +- ERR@20: 0.209148
  125 +- ERR@5: 0.139632
  126 +- ERR@50: 0.20915
  127 +- Exact_Precision@10: 0.1
  128 +- Exact_Precision@20: 0.2
  129 +- Exact_Precision@5: 0.0
  130 +- Exact_Success@10: 1.0
  131 +- Exact_Success@5: 0.0
  132 +- Gain_Recall@10: 0.013158
  133 +- Gain_Recall@50: 0.084795
  134 +- MRR_Exact@10: 0.111111
  135 +- MRR_Strong@10: 0.111111
  136 +- NDCG@10: 0.259788
  137 +- NDCG@5: 0.22028
  138 +- Strong_Precision@5: 0.0
  139 +- Strong_Success@10: 1.0
  140 +- Strong_Success@5: 0.0
  141 +- Useful_Precision@10: 0.7
  142 +- Useful_Precision@20: 0.75
  143 +- Fully Relevant: 14
  144 +- Mostly Relevant: 10
  145 +- Weakly Relevant: 36
  146 +- Irrelevant: 40
  147 +- Request ID: `ebbbc848`
  148 +- Top-10 Labels: `1:L0 | 2:L1 | 3:L1 | 4:L1 | 5:L1 | 6:L1 | 7:L1 | 8:L0 | 9:L3 | 10:L0`
  149 +- Top-20 Labels: `1:L0 | 2:L1 | 3:L1 | 4:L1 | 5:L1 | 6:L1 | 7:L1 | 8:L0 | 9:L3 | 10:L0 | 11:L0 | 12:L3 | 13:L1 | 14:L1 | 15:L1 | 16:L1 | 17:L0 | 18:L2 | 19:L3 | 20:L3`
  150 +- Case Snapshot:
  151 + - #1 [L0] spu=67582 Panana Modern 6 Drawer Dresser for Bedroom, Wood Wide Chest of Drawers Floor Storage Lateral Drawer Cabinet Organizer with Metal Handles for Home Office (Black) (rel=119.326416)
  152 + zh: Panana 现代6抽屉卧室衣柜，实木宽体落地侧边储物柜，金属把手，适用于家庭办公室（黑色）
  153 + - #2 [L1] spu=61010 Black Mini Skirt Skort for Women Leopard Pencil Bodycon Short Skirts with Shorts Underneath y2k Cargo Skirt (rel=127.642525)
  154 + zh: 黑色女士豹纹迷你裙 时尚高腰包臀短裙 带内衬短裤 y2k工装风短裙
  155 + - #3 [L1] spu=60682 Women's Black Leather Skirts High Waisted High Side Slit Bodycon Mini Skirts (rel=134.97229)
  156 + zh: 女式黑色皮革高腰侧开叉包臀迷你裙
  157 + - #4 [L1] spu=67412 Women's Black Leather Skirts High Waisted High Side Slit Bodycon Mini Skirts (rel=134.0142)
  158 + zh: 女式黑色皮革高腰侧开叉包臀迷你裙
  159 + - #5 [L1] spu=61600 Women's Faux Leather Black Mini Skirt Classic high Waisted Skirt Pleated Skirt PU Black Leather Skirt (rel=123.479836)
  160 + zh: 女式黑色仿皮短裙 修身高腰褶皱PU皮革短裙
  161 +
  162 +### red fitted tee
  163 +
  164 +- Primary_Metric_Score: 0.331966
  165 +- NDCG@20: 0.341885
  166 +- NDCG@50: 0.379725
  167 +- ERR@10: 0.444863
  168 +- Strong_Precision@10: 0.3
  169 +- Strong_Precision@20: 0.2
  170 +- Useful_Precision@50: 0.64
  171 +- Avg_Grade@10: 1.0
  172 +- Gain_Recall@20: 0.015924
  173 +- ERR@10: 0.444863
  174 +- ERR@20: 0.449985
  175 +- ERR@5: 0.394531
  176 +- ERR@50: 0.452293
  177 +- Exact_Precision@10: 0.0
  178 +- Exact_Precision@20: 0.0
  179 +- Exact_Precision@5: 0.0
  180 +- Exact_Success@10: 0.0
  181 +- Exact_Success@5: 0.0
  182 +- Gain_Recall@10: 0.010616
  183 +- Gain_Recall@50: 0.043524
  184 +- MRR_Exact@10: 0.0
  185 +- MRR_Strong@10: 1.0
  186 +- NDCG@10: 0.383519
  187 +- NDCG@5: 0.274796
  188 +- Strong_Precision@5: 0.2
  189 +- Strong_Success@10: 1.0
  190 +- Strong_Success@5: 1.0
  191 +- Useful_Precision@10: 0.7
  192 +- Useful_Precision@20: 0.55
  193 +- Fully Relevant: 1
  194 +- Mostly Relevant: 13
  195 +- Weakly Relevant: 50
  196 +- Irrelevant: 36
  197 +- Request ID: `4896c7bb`
  198 +- Top-10 Labels: `1:L2 | 2:L0 | 3:L0 | 4:L1 | 5:L0 | 6:L1 | 7:L1 | 8:L1 | 9:L2 | 10:L2`
  199 +- Top-20 Labels: `1:L2 | 2:L0 | 3:L0 | 4:L1 | 5:L0 | 6:L1 | 7:L1 | 8:L1 | 9:L2 | 10:L2 | 11:L0 | 12:L0 | 13:L0 | 14:L0 | 15:L1 | 16:L2 | 17:L0 | 18:L1 | 19:L1 | 20:L0`
  200 +- Case Snapshot:
  201 + - #1 [L2] spu=63217 Titties and Beer Funny St Patricks Day 2020 T-Shirt Small (rel=90.02195)
  202 + zh: Titties and Beer 搞笑圣帕特里克节2020款T恤 小号
  203 + - #2 [L0] spu=61485 Letter M Halloween Costumes T-Shirt | Funny Cool Graphic tee idea | for Women (rel=136.30348)
  204 + zh: 字母M万圣节服装T恤 | 幽默酷炫图案衫 | 女士款
  205 + - #3 [L0] spu=62633 Letter M Halloween Costumes T-Shirt | Funny Cool Graphic tee idea | for Women (rel=136.30348)
  206 + zh: 字母M万圣节服装T恤 | 幽默酷炫图案衫 | 女士款
  207 + - #4 [L1] spu=67270 Men's T-Shirt (rel=103.66833)
  208 + zh: 男式T恤
  209 + - #5 [L0] spu=67361 Free People Womens Total Eclipse Tee (rel=136.2946)
  210 + zh: Free People 女士全食天象短袖T恤
  211 +
  212 +### 黒いミディ丈スカート
  213 +
  214 +- Primary_Metric_Score: 0.568828
  215 +- NDCG@20: 0.632466
  216 +- NDCG@50: 0.583396
  217 +- ERR@10: 0.916912
  218 +- Strong_Precision@10: 0.4
  219 +- Strong_Precision@20: 0.6
  220 +- Useful_Precision@50: 0.82
  221 +- Avg_Grade@10: 1.6
  222 +- Gain_Recall@20: 0.064516
  223 +- ERR@10: 0.916912
  224 +- ERR@20: 0.917132
  225 +- ERR@5: 0.916209
  226 +- ERR@50: 0.917132
  227 +- Exact_Precision@10: 0.2
  228 +- Exact_Precision@20: 0.25
  229 +- Exact_Precision@5: 0.4
  230 +- Exact_Success@10: 1.0
  231 +- Exact_Success@5: 1.0
  232 +- Gain_Recall@10: 0.028674
  233 +- Gain_Recall@50: 0.137993
  234 +- MRR_Exact@10: 1.0
  235 +- MRR_Strong@10: 1.0
  236 +- NDCG@10: 0.611154
  237 +- NDCG@5: 0.721183
  238 +- Strong_Precision@5: 0.6
  239 +- Strong_Success@10: 1.0
  240 +- Strong_Success@5: 1.0
  241 +- Useful_Precision@10: 1.0
  242 +- Useful_Precision@20: 0.95
  243 +- Fully Relevant: 19
  244 +- Mostly Relevant: 23
  245 +- Weakly Relevant: 31
  246 +- Irrelevant: 27
  247 +- Request ID: `e49c9628`
  248 +- Top-10 Labels: `1:L3 | 2:L1 | 3:L3 | 4:L2 | 5:L1 | 6:L2 | 7:L1 | 8:L1 | 9:L1 | 10:L1`
  249 +- Top-20 Labels: `1:L3 | 2:L1 | 3:L3 | 4:L2 | 5:L1 | 6:L2 | 7:L1 | 8:L1 | 9:L1 | 10:L1 | 11:L1 | 12:L2 | 13:L3 | 14:L3 | 15:L3 | 16:L2 | 17:L2 | 18:L2 | 19:L2 | 20:L0`
  250 +- Case Snapshot:
  251 + - #1 [L3] spu=62090 Amazon Essentials Women's Jersey Pull On Midi Length Skirt (rel=119.379166)
  252 + zh: 亚马逊精选 女士针织抽绳中长裙
  253 + - #2 [L1] spu=68554 Women's Black A-line Midi Skirt, Korean Style, Slimming, Flowy, High-Waisted Bodycon with Fish-Tail Hem, Spring & Autumn (rel=247.65866)
  254 + zh: 黑色半身裙女春秋季韩版气质显瘦遮肉垂感中长款a字鱼尾包臀裙子
  255 + - #3 [L3] spu=68396 T~ Row Skirt Women's 2025 Spring and Autum New Niche Normcore Style High Waist Black Straight Hip Skirt Half Skirt (rel=144.8624)
  256 + zh: T型行裙 女士2025春秋季新款小众极简风 高腰黑色直筒半身裙
  257 + - #4 [L2] spu=68290 Th~ Row Skirt Women's 2025 Spring & Fall New High-Waisted Straight Black Slimming Look Normcore Style Hip Skirt Long Style (rel=138.72072)
  258 + zh: 2025春秋季新款女式高腰直筒黑色显瘦简约风长款半身裙
  259 + - #5 [L1] spu=60818 Keasmto Leopard Skirt for Women Midi Length High Waist Silk Satin Elasticized Cheetah Casual Ladies Skirts (rel=150.6583)
  260 + zh: Keasmto 女士豹纹半身裙 中长款 高腰 丝缎弹力 花豹休闲裙
  261 +
  262 +### 黑色中长半身裙
  263 +
  264 +- Primary_Metric_Score: 0.639523
  265 +- NDCG@20: 0.678522
  266 +- NDCG@50: 0.569833
  267 +- ERR@10: 0.912859
  268 +- Strong_Precision@10: 0.7
  269 +- Strong_Precision@20: 0.5
  270 +- Useful_Precision@50: 0.92
  271 +- Avg_Grade@10: 2.3
  272 +- Gain_Recall@20: 0.068301
  273 +- ERR@10: 0.912859
  274 +- ERR@20: 0.912859
  275 +- ERR@5: 0.911652
  276 +- ERR@50: 0.912859
  277 +- Exact_Precision@10: 0.6
  278 +- Exact_Precision@20: 0.45
  279 +- Exact_Precision@5: 0.4
  280 +- Exact_Success@10: 1.0
  281 +- Exact_Success@5: 1.0
  282 +- Gain_Recall@10: 0.04028
  283 +- Gain_Recall@50: 0.136602
  284 +- MRR_Exact@10: 1.0
  285 +- MRR_Strong@10: 1.0
  286 +- NDCG@10: 0.765072
  287 +- NDCG@5: 0.713346
  288 +- Strong_Precision@5: 0.6
  289 +- Strong_Success@10: 1.0
  290 +- Strong_Success@5: 1.0
  291 +- Useful_Precision@10: 1.0
  292 +- Useful_Precision@20: 1.0
  293 +- Fully Relevant: 25
  294 +- Mostly Relevant: 7
  295 +- Weakly Relevant: 54
  296 +- Irrelevant: 14
  297 +- Request ID: `c811a0be`
  298 +- Top-10 Labels: `1:L3 | 2:L1 | 3:L2 | 4:L3 | 5:L1 | 6:L3 | 7:L1 | 8:L3 | 9:L3 | 10:L3`
  299 +- Top-20 Labels: `1:L3 | 2:L1 | 3:L2 | 4:L3 | 5:L1 | 6:L3 | 7:L1 | 8:L3 | 9:L3 | 10:L3 | 11:L1 | 12:L1 | 13:L1 | 14:L1 | 15:L1 | 16:L1 | 17:L3 | 18:L3 | 19:L1 | 20:L3`
  300 +- Case Snapshot:
  301 + - #1 [L3] spu=68380 Pendant Fashion Mid-length A- line Skirt Women's Autumn and Summer Black Skirt Chubby m High Waist Slim Half-length Sheath Split Skirt (rel=204.02559)
  302 + zh: 时尚中长款A字裙 女士秋夏季黑色胖虎高腰显瘦半身裙 分体开叉设计
  303 + - #2 [L1] spu=68554 Women's Black A-line Midi Skirt, Korean Style, Slimming, Flowy, High-Waisted Bodycon with Fish-Tail Hem, Spring & Autumn (rel=157.49411)
  304 + zh: 黑色半身裙女春秋季韩版气质显瘦遮肉垂感中长款a字鱼尾包臀裙子
  305 + - #3 [L2] spu=68507 Irregular Tulle Skirt 2025 Spring/Summer New Mid-Length Pleated Fairy Skirt High-Waisted Slimming Black Tulle Skirt (rel=191.03882)
  306 + zh: 不规则网纱半身裙2025春秋新款中长款百褶仙女裙高腰显瘦黑色纱裙
  307 + - #4 [L3] spu=68396 T~ Row Skirt Women's 2025 Spring and Autum New Niche Normcore Style High Waist Black Straight Hip Skirt Half Skirt (rel=115.607506)
  308 + zh: T型行裙 女士2025春秋季新款小众极简风 高腰黑色直筒半身裙
  309 + - #5 [L1] spu=68479 2026 Korean-style High-waisted Slimming Corduroy Skirt with Slit, Mid-Length Coffee-colored Skirt for Women (rel=150.95795)
  310 + zh: 2026款韩版高腰显瘦雪尼尔包臀裙灯芯绒开叉中长款咖啡色半身裙女
  311 +
  312 +### فستان أسود متوسط الطول
  313 +
  314 +- Primary_Metric_Score: 0.434969
  315 +- NDCG@20: 0.458494
  316 +- NDCG@50: 0.474748
  317 +- ERR@10: 0.213929
  318 +- Strong_Precision@10: 0.5
  319 +- Strong_Precision@20: 0.5
  320 +- Useful_Precision@50: 0.8
  321 +- Avg_Grade@10: 1.5
  322 +- Gain_Recall@20: 0.032577
  323 +- ERR@10: 0.213929
  324 +- ERR@20: 0.213972
  325 +- ERR@5: 0.098958
  326 +- ERR@50: 0.213972
  327 +- Exact_Precision@10: 0.3
  328 +- Exact_Precision@20: 0.3
  329 +- Exact_Precision@5: 0.0
  330 +- Exact_Success@10: 1.0
  331 +- Exact_Success@5: 0.0
  332 +- Gain_Recall@10: 0.014808
  333 +- Gain_Recall@50: 0.076012
  334 +- MRR_Exact@10: 0.142857
  335 +- MRR_Strong@10: 0.166667
  336 +- NDCG@10: 0.386698
  337 +- NDCG@5: 0.127855
  338 +- Strong_Precision@5: 0.0
  339 +- Strong_Success@10: 1.0
  340 +- Strong_Success@5: 0.0
  341 +- Useful_Precision@10: 0.7
  342 +- Useful_Precision@20: 0.85
  343 +- Fully Relevant: 18
  344 +- Mostly Relevant: 17
  345 +- Weakly Relevant: 40
  346 +- Irrelevant: 25
  347 +- Request ID: `898c69f8`
  348 +- Top-10 Labels: `1:L0 | 2:L1 | 3:L1 | 4:L0 | 5:L0 | 6:L2 | 7:L3 | 8:L3 | 9:L3 | 10:L2`
  349 +- Top-20 Labels: `1:L0 | 2:L1 | 3:L1 | 4:L0 | 5:L0 | 6:L2 | 7:L3 | 8:L3 | 9:L3 | 10:L2 | 11:L2 | 12:L1 | 13:L1 | 14:L1 | 15:L1 | 16:L1 | 17:L3 | 18:L3 | 19:L2 | 20:L3`
  350 +- Case Snapshot:
  351 + - #1 [L0] spu=68554 Women's Black A-line Midi Skirt, Korean Style, Slimming, Flowy, High-Waisted Bodycon with Fish-Tail Hem, Spring & Autumn (rel=195.44751)
  352 + zh: 黑色半身裙女春秋季韩版气质显瘦遮肉垂感中长款a字鱼尾包臀裙子
  353 + - #2 [L1] spu=68474 2026 New Fashionable Minimalist Style Black Side-Slit Office Skirt with Buttons (rel=174.36389)
  354 + zh: 2026新款小众设计感气质百搭排扣OL西装裙侧开叉黑色半身裙职业裙
  355 + - #3 [L1] spu=69063 Amazon Cross-border European and American Elegant Sleeveless Sling dress Summer New High Waist Pleated A- line Midi Dress (rel=69.57374)
  356 + zh: 亚马逊跨境欧美优雅无袖斜挎裙 夏季新款高腰褶皱A字中长裙
  357 + - #4 [L0] spu=68290 Th~ Row Skirt Women's 2025 Spring & Fall New High-Waisted Straight Black Slimming Look Normcore Style Hip Skirt Long Style (rel=92.58122)
  358 + zh: 2025春秋季新款女式高腰直筒黑色显瘦简约风长款半身裙
  359 + - #5 [L0] spu=68775 Cross-border Hot Sale New High Waist Styline V-neck Mid-length Dress plus size Elegant Printed Black Sexy Styline dress (rel=72.87891)
  360 + zh: 跨境热销 新款高腰V领中长款连衣裙 加大码 优雅印花黑色性感连衣裙
  361 +
  362 +### чёрное летнее платье
  363 +
  364 +- Primary_Metric_Score: 0.473916
  365 +- NDCG@20: 0.53902
  366 +- NDCG@50: 0.537146
  367 +- ERR@10: 0.347065
  368 +- Strong_Precision@10: 0.4
  369 +- Strong_Precision@20: 0.4
  370 +- Useful_Precision@50: 0.94
  371 +- Avg_Grade@10: 1.8
  372 +- Gain_Recall@20: 0.028099
  373 +- ERR@10: 0.347065
  374 +- ERR@20: 0.347074
  375 +- ERR@5: 0.335105
  376 +- ERR@50: 0.347074
  377 +- Exact_Precision@10: 0.4
  378 +- Exact_Precision@20: 0.35
  379 +- Exact_Precision@5: 0.2
  380 +- Exact_Success@10: 1.0
  381 +- Exact_Success@5: 1.0
  382 +- Gain_Recall@10: 0.014876
  383 +- Gain_Recall@50: 0.067769
  384 +- MRR_Exact@10: 0.2
  385 +- MRR_Strong@10: 0.2
  386 +- NDCG@10: 0.537558
  387 +- NDCG@5: 0.420803
  388 +- Strong_Precision@5: 0.2
  389 +- Strong_Success@10: 1.0
  390 +- Strong_Success@5: 1.0
  391 +- Useful_Precision@10: 1.0
  392 +- Useful_Precision@20: 0.95
  393 +- Fully Relevant: 22
  394 +- Mostly Relevant: 30
  395 +- Weakly Relevant: 41
  396 +- Irrelevant: 7
  397 +- Request ID: `3d76062d`
  398 +- Top-10 Labels: `1:L1 | 2:L1 | 3:L1 | 4:L1 | 5:L3 | 6:L3 | 7:L3 | 8:L3 | 9:L1 | 10:L1`
  399 +- Top-20 Labels: `1:L1 | 2:L1 | 3:L1 | 4:L1 | 5:L3 | 6:L3 | 7:L3 | 8:L3 | 9:L1 | 10:L1 | 11:L3 | 12:L1 | 13:L1 | 14:L3 | 15:L3 | 16:L0 | 17:L1 | 18:L2 | 19:L1 | 20:L1`
  400 +- Case Snapshot:
  401 + - #1 [L1] spu=68775 Cross-border Hot Sale New High Waist Styline V-neck Mid-length Dress plus size Elegant Printed Black Sexy Styline dress (rel=88.28372)
  402 + zh: 跨境热销 新款高腰V领中长款连衣裙 加大码 优雅印花黑色性感连衣裙
  403 + - #2 [L1] spu=68914 2026 Cross-Border Summer New Denim Suspender Dress for Women, European and American Fashion Casual Amazon Hot-Selling Trendy Dress (rel=49.81091)
  404 + zh: 2026跨境夏季新款女式牛仔背带裙 欧美风休闲亚马逊热卖潮流裙
  405 + - #3 [L1] spu=68993 Cross-border 2025 European and American Spring and Summer New Mesh Printed Sling dress INS Vacation Leisure Party dress (rel=51.41769)
  406 + zh: 跨境2025欧美春季夏季新款网眼印花吊带裙 旅游休闲派对裙
  407 + - #4 [L1] spu=68780 2026 European and American Amazon Summer New Women's Round Neck Short-Sleeved Long Dress Bohemian Printed Dress for Women (rel=47.778248)
  408 + zh: 2026欧美亚马逊夏季新款女式圆领短袖长裙波西米亚印花连衣裙
  409 + - #5 [L3] spu=61718 Manydress Women's Chiffon Floral Dresses Casual Summer Boho Flutter Sleeve Flowy Skater Western Dress MY112 (rel=57.206028)
  410 + zh: Manydress 女士雪纺印花连衣裙 夏季休闲波西米亚风荷叶袖飘逸A字裙 西部风情裙 MY112
  411 +
  412 +### 修身牛仔裤
  413 +
  414 +- Primary_Metric_Score: 0.802715
  415 +- NDCG@20: 0.886864
  416 +- NDCG@50: 0.827827
  417 +- ERR@10: 0.93472
  418 +- Strong_Precision@10: 0.9
  419 +- Strong_Precision@20: 0.85
  420 +- Useful_Precision@50: 0.98
  421 +- Avg_Grade@10: 2.8
  422 +- Gain_Recall@20: 0.108974
  423 +- ERR@10: 0.93472
  424 +- ERR@20: 0.93472
  425 +- ERR@5: 0.934715
  426 +- ERR@50: 0.93472
  427 +- Exact_Precision@10: 0.9
  428 +- Exact_Precision@20: 0.75
  429 +- Exact_Precision@5: 1.0
  430 +- Exact_Success@10: 1.0
  431 +- Exact_Success@5: 1.0
  432 +- Gain_Recall@10: 0.059829
  433 +- Gain_Recall@50: 0.241453
  434 +- MRR_Exact@10: 1.0
  435 +- MRR_Strong@10: 1.0
  436 +- NDCG@10: 0.955831
  437 +- NDCG@5: 1.0
  438 +- Strong_Precision@5: 1.0
  439 +- Strong_Success@10: 1.0
  440 +- Strong_Success@5: 1.0
  441 +- Useful_Precision@10: 1.0
  442 +- Useful_Precision@20: 0.95
  443 +- Fully Relevant: 41
  444 +- Mostly Relevant: 13
  445 +- Weakly Relevant: 39
  446 +- Irrelevant: 7
  447 +- Request ID: `73feb89f`
  448 +- Top-10 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L3 | 6:L3 | 7:L3 | 8:L3 | 9:L1 | 10:L3`
  449 +- Top-20 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L3 | 6:L3 | 7:L3 | 8:L3 | 9:L1 | 10:L3 | 11:L3 | 12:L1 | 13:L0 | 14:L3 | 15:L3 | 16:L3 | 17:L3 | 18:L3 | 19:L2 | 20:L2`
  450 +- Case Snapshot:
  451 + - #1 [L3] spu=64978 Lee Womens Ultra Lux Comfort with Flex Motion Skinny Leg Jean with Ever Fit (rel=242.09778)
  452 + zh: 李女士超舒适弹力修身牛仔裤（含永恒贴合技术）
  453 + - #2 [L3] spu=63973 Judy Blue Women's High Rise Exposed Button Fly Skinny Jeans (7, MD), 28 (rel=230.77084)
  454 + zh: Judy Blue 女士高腰露扣修身牛仔裤（7码，中等身材），28英寸
  455 + - #3 [L3] spu=66005 Judy Blue Women's High Rise Exposed Button Fly Skinny Jeans (7, MD), 28 (rel=230.77084)
  456 + zh: Judy Blue 女士高腰露扣修身牛仔裤（7码，中等身材），28英寸
  457 + - #4 [L3] spu=61574 Judy Blue Women's High Waist Button Fly Skinny Jeans 82319 (rel=241.57698)
  458 + zh: Judy Blue 女士高腰纽扣开叉修身牛仔裤 82319
  459 + - #5 [L3] spu=68607 Wish Amazon Ebay Hot Selling Women's Jeans High Waist Sexy Stretch Slim Jeans for Women (rel=333.78857)
  460 + zh: Wish 亚马逊 速卖通 爆款 女士高腰性感弹力修身牛仔裤
  461 +
  462 +### date night dress
  463 +
  464 +- Primary_Metric_Score: 0.734194
  465 +- NDCG@20: 0.772498
  466 +- NDCG@50: 0.870892
  467 +- ERR@10: 0.917436
  468 +- Strong_Precision@10: 0.8
  469 +- Strong_Precision@20: 0.75
  470 +- Useful_Precision@50: 0.94
  471 +- Avg_Grade@10: 2.4
  472 +- Gain_Recall@20: 0.022727
  473 +- ERR@10: 0.917436
  474 +- ERR@20: 0.917436
  475 +- ERR@5: 0.917236
  476 +- ERR@50: 0.917436
  477 +- Exact_Precision@10: 0.7
  478 +- Exact_Precision@20: 0.7
  479 +- Exact_Precision@5: 0.6
  480 +- Exact_Success@10: 1.0
  481 +- Exact_Success@5: 1.0
  482 +- Gain_Recall@10: 0.011858
  483 +- Gain_Recall@50: 0.0667
  484 +- MRR_Exact@10: 1.0
  485 +- MRR_Strong@10: 1.0
  486 +- NDCG@10: 0.797379
  487 +- NDCG@5: 0.759091
  488 +- Strong_Precision@5: 0.8
  489 +- Strong_Success@10: 1.0
  490 +- Strong_Success@5: 1.0
  491 +- Useful_Precision@10: 0.9
  492 +- Useful_Precision@20: 0.85
  493 +- Fully Relevant: 84
  494 +- Mostly Relevant: 4
  495 +- Weakly Relevant: 2
  496 +- Irrelevant: 10
  497 +- Request ID: `d4cb4193`
  498 +- Top-10 Labels: `1:L3 | 2:L2 | 3:L0 | 4:L3 | 5:L3 | 6:L3 | 7:L3 | 8:L1 | 9:L3 | 10:L3`
  499 +- Top-20 Labels: `1:L3 | 2:L2 | 3:L0 | 4:L3 | 5:L3 | 6:L3 | 7:L3 | 8:L1 | 9:L3 | 10:L3 | 11:L3 | 12:L3 | 13:L1 | 14:L0 | 15:L0 | 16:L3 | 17:L3 | 18:L3 | 19:L3 | 20:L3`
  500 +- Case Snapshot:
  501 + - #1 [L3] spu=62014 OWIN Women's 2025 Sexy V Neck Spaghetti Straps Wrap Ruched Sheath Bodycon Cocktail Evening Party Night Club Dresses (rel=123.663795)
  502 + zh: OWIN 女士2025年性感V领细带裹身褶皱修身小礼服晚宴派对夜店连衣裙
  503 + - #2 [L2] spu=66318 Caracilia Womens Mesh Dress Long Sleeve Mock Neck Bodycon Sheer Going Out Cocktail Night Club Midi Dresses 3 Piece Outfits (rel=134.29068)
  504 + zh: Caracilia 女士网纱长袖高领修身透视连衣裙 3件套晚宴俱乐部中长款礼服
  505 + - #3 [L0] spu=67323 chicyes Women's Jumpsuits Dressy Date Night Rompers Long Sleeve Bodycon Pants Birthday Party Outfits Clothes (rel=148.38367)
  506 + zh: chicyes 女士连体裤 优雅约会装 长袖修身裤 生日派对服饰 连衣裤
  507 + - #4 [L3] spu=67383 Women's Strapless Rhinestone Mermaid Floor-Length Evening Gown Luxury Formal Dress for Party Club Night Star of Galas (rel=146.44154)
  508 + zh: 女士无肩带水钻仙女裙长款晚礼服 时尚宴会俱乐部夜宴礼服 星光璀璨
  509 + - #5 [L3] spu=69272 Women's Strapless Rhinestone Mermaid Floor-Length Evening Gown Luxury Formal Dress for Party Club Night Star of Galas (rel=146.44154)
  510 + zh: 女士无肩带水钻仙女裙长款晚礼服 时尚宴会俱乐部夜宴礼服 星光璀璨
  511 +
  512 +### vacation outfit dress
  513 +
  514 +- Primary_Metric_Score: 0.828393
  515 +- NDCG@20: 0.953471
  516 +- NDCG@50: 0.851858
  517 +- ERR@10: 0.93472
  518 +- Strong_Precision@10: 1.0
  519 +- Strong_Precision@20: 0.9
  520 +- Useful_Precision@50: 0.96
  521 +- Avg_Grade@10: 3.0
  522 +- Gain_Recall@20: 0.027092
  523 +- ERR@10: 0.93472
  524 +- ERR@20: 0.93472
  525 +- ERR@5: 0.934715
  526 +- ERR@50: 0.93472
  527 +- Exact_Precision@10: 1.0
  528 +- Exact_Precision@20: 0.9
  529 +- Exact_Precision@5: 1.0
  530 +- Exact_Success@10: 1.0
  531 +- Exact_Success@5: 1.0
  532 +- Gain_Recall@10: 0.014514
  533 +- Gain_Recall@50: 0.058539
  534 +- MRR_Exact@10: 1.0
  535 +- MRR_Strong@10: 1.0
  536 +- NDCG@10: 1.0
  537 +- NDCG@5: 1.0
  538 +- Strong_Precision@5: 1.0
  539 +- Strong_Success@10: 1.0
  540 +- Strong_Success@5: 1.0
  541 +- Useful_Precision@10: 1.0
  542 +- Useful_Precision@20: 1.0
  543 +- Fully Relevant: 50
  544 +- Mostly Relevant: 13
  545 +- Weakly Relevant: 26
  546 +- Irrelevant: 11
  547 +- Request ID: `0dee7ea2`
  548 +- Top-10 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L3 | 6:L3 | 7:L3 | 8:L3 | 9:L3 | 10:L3`
  549 +- Top-20 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L3 | 6:L3 | 7:L3 | 8:L3 | 9:L3 | 10:L3 | 11:L3 | 12:L3 | 13:L3 | 14:L1 | 15:L3 | 16:L3 | 17:L3 | 18:L1 | 19:L3 | 20:L3`
  550 +- Case Snapshot:
  551 + - #1 [L3] spu=60921 ANRABESS Women Summer Maxi Dress Beach Vacation Sundress Sleeveless Casual Loose Shirt Dresses 2025 Travel Outfits (rel=160.13692)
  552 + zh: ANRABESS 女士2025夏季长款沙滩度假连衣裙无袖休闲宽松衬衫风连衣裙旅行穿搭
  553 + - #2 [L3] spu=63110 VOTEPRETTY Women's Summer Dresses Spring Sundresses Beach Clothes Outfit Vacation 2024 V Neck Casual Tropical Resort Hawaiian (rel=149.24443)
  554 + zh: VOTEPRETTY 女士夏季连衣裙 春装沙滩服度假套装 2024 V领休闲热带度假夏威夷风
  555 + - #3 [L3] spu=66459 VOTEPRETTY Women's Summer Dresses Spring Sundresses Beach Clothes Outfit Vacation 2024 V Neck Casual Tropical Resort Hawaiian (rel=149.24443)
  556 + zh: VOTEPRETTY 女士夏季连衣裙 春装沙滩服度假套装 2024 V领休闲热带度假夏威夷风
  557 + - #4 [L3] spu=68890 2025 Spring/Summer Cross-Border Sleeveless Vertical Striped Casual Vacation Style Dress Fashionable Elegant Princess Long Dress with Large Hem (rel=114.53043)
  558 + zh: 2025春夏季跨境无袖竖条纹休闲度假风连衣裙 时尚优雅公主长裙 大摆设计
  559 + - #5 [L3] spu=67301 Summer Dresses for Women 2025 Plus Size Spring Clothes Beach Vacation Fashion Maxi Casual Outfits (rel=150.06898)
  560 + zh: 2025夏季女装大码连衣裙 春装沙滩度假休闲时尚长裙
  561 +
  562 +### minimalist top
  563 +
  564 +- Primary_Metric_Score: 0.41099
  565 +- NDCG@20: 0.463909
  566 +- NDCG@50: 0.382121
  567 +- ERR@10: 0.579467
  568 +- Strong_Precision@10: 0.4
  569 +- Strong_Precision@20: 0.45
  570 +- Useful_Precision@50: 0.6
  571 +- Avg_Grade@10: 1.2
  572 +- Gain_Recall@20: 0.01242
  573 +- ERR@10: 0.579467
  574 +- ERR@20: 0.581169
  575 +- ERR@5: 0.573568
  576 +- ERR@50: 0.581171
  577 +- Exact_Precision@10: 0.1
  578 +- Exact_Precision@20: 0.15
  579 +- Exact_Precision@5: 0.2
  580 +- Exact_Success@10: 1.0
  581 +- Exact_Success@5: 1.0
  582 +- Gain_Recall@10: 0.00552
  583 +- Gain_Recall@50: 0.024379
  584 +- MRR_Exact@10: 0.333333
  585 +- MRR_Strong@10: 1.0
  586 +- NDCG@10: 0.440232
  587 +- NDCG@5: 0.467016
  588 +- Strong_Precision@5: 0.4
  589 +- Strong_Success@10: 1.0
  590 +- Strong_Success@5: 1.0
  591 +- Useful_Precision@10: 0.7
  592 +- Useful_Precision@20: 0.75
  593 +- Fully Relevant: 16
  594 +- Mostly Relevant: 12
  595 +- Weakly Relevant: 40
  596 +- Irrelevant: 32
  597 +- Request ID: `3a095651`
  598 +- Top-10 Labels: `1:L2 | 2:L1 | 3:L3 | 4:L0 | 5:L0 | 6:L1 | 7:L1 | 8:L0 | 9:L2 | 10:L2`
  599 +- Top-20 Labels: `1:L2 | 2:L1 | 3:L3 | 4:L0 | 5:L0 | 6:L1 | 7:L1 | 8:L0 | 9:L2 | 10:L2 | 11:L1 | 12:L3 | 13:L3 | 14:L0 | 15:L2 | 16:L2 | 17:L1 | 18:L1 | 19:L0 | 20:L2`
  600 +- Case Snapshot:
  601 + - #1 [L2] spu=69138 Shijian Owner's Favorite, Elegant V-Neck Short Sleeve Cotton T-Shirt, Soft Pure Cotton, Spring 2026 New Arrival, Style No. 40275 (rel=87.0189)
  602 + zh: 时简 店主私服挚爱 精致V领短袖T恤纯棉亲肤2026春新款上衣40275
  603 + - #2 [L1] spu=68396 T~ Row Skirt Women's 2025 Spring and Autum New Niche Normcore Style High Waist Black Straight Hip Skirt Half Skirt (rel=69.75375)
  604 + zh: T型行裙 女士2025春秋季新款小众极简风 高腰黑色直筒半身裙
  605 + - #3 [L3] spu=69119 2026 French Retro Minimalist Style Slim Fit Merino Wool Short-Sleeve T-Shirt for Women Early Spring Top (rel=131.34145)
  606 + zh: 2026年法式复古极简风女士修身美利奴羊毛短袖T恤 春季上装
  607 + - #4 [L0] spu=66820 Binienty Women's Men's Print High Top Wide Toe Box Minimalist Barefoot Shoes Lace Up Trail Running Sneakers (rel=132.0825)
  608 + zh: Binienty 女士男士印花高帮宽头型极简赤足系带越野跑步休闲鞋
  609 + - #5 [L0] spu=60600 WHITIN Men's Wide Minimalist Barefoot Sneakers | Zero Drop Sole | Optimal Relaxation (rel=118.928345)
  610 + zh: WHITIN 男款宽版极简赤足运动鞋 | 零落差鞋底 | 优化放松体验
  611 +
  612 +### streetwear t-shirt
  613 +
  614 +- Primary_Metric_Score: 0.691802
  615 +- NDCG@20: 0.642955
  616 +- NDCG@50: 0.595853
  617 +- ERR@10: 0.923329
  618 +- Strong_Precision@10: 1.0
  619 +- Strong_Precision@20: 0.65
  620 +- Useful_Precision@50: 0.9
  621 +- Avg_Grade@10: 2.4
  622 +- Gain_Recall@20: 0.022282
  623 +- ERR@10: 0.923329
  624 +- ERR@20: 0.92333
  625 +- ERR@5: 0.923208
  626 +- ERR@50: 0.92333
  627 +- Exact_Precision@10: 0.4
  628 +- Exact_Precision@20: 0.2
  629 +- Exact_Precision@5: 0.6
  630 +- Exact_Success@10: 1.0
  631 +- Exact_Success@5: 1.0
  632 +- Gain_Recall@10: 0.016205
  633 +- Gain_Recall@50: 0.055368
  634 +- MRR_Exact@10: 1.0
  635 +- MRR_Strong@10: 1.0
  636 +- NDCG@10: 0.831226
  637 +- NDCG@5: 0.879982
  638 +- Strong_Precision@5: 1.0
  639 +- Strong_Success@10: 1.0
  640 +- Strong_Success@5: 1.0
  641 +- Useful_Precision@10: 1.0
  642 +- Useful_Precision@20: 0.8
  643 +- Fully Relevant: 15
  644 +- Mostly Relevant: 42
  645 +- Weakly Relevant: 31
  646 +- Irrelevant: 12
  647 +- Request ID: `fc8518ec`
  648 +- Top-10 Labels: `1:L3 | 2:L2 | 3:L3 | 4:L2 | 5:L3 | 6:L3 | 7:L2 | 8:L2 | 9:L2 | 10:L2`
  649 +- Top-20 Labels: `1:L3 | 2:L2 | 3:L3 | 4:L2 | 5:L3 | 6:L3 | 7:L2 | 8:L2 | 9:L2 | 10:L2 | 11:L2 | 12:L0 | 13:L0 | 14:L1 | 15:L0 | 16:L2 | 17:L2 | 18:L1 | 19:L1 | 20:L0`
  650 +- Case Snapshot:
  651 + - #1 [L3] spu=62946 Verdusa Jersey Shirts for Women Y2K Graphic Tees Oversized Streetwear T Shirt V Neck Football Jersey (rel=494.14374)
  652 + zh: Verdusa 女士耶罗衫 2000年代风格印花宽松街头T恤 V领足球队衫
  653 + - #2 [L2] spu=65691 in My Defense I was Left Unsupervised Cool Funny T-Shirt (rel=250.95062)
  654 + zh: 辩护我曾无人监管 搞笑个性T恤
  655 + - #3 [L3] spu=66657 Milumia Women's Graphic Print Mesh T Shirt Vintage Grunge Short Sleeve Loose Tee Tops Streetwear (rel=222.88773)
  656 + zh: Milumia 女士复古朋克印花网眼短袖宽松T恤 街头风上衣
  657 + - #4 [L2] spu=61739 Add Your Text Custom T-Shirt Men's Customizable Tee Personlized Tshirt (rel=139.46754)
  658 + zh: 自定义文字男士定制T恤 个性印花T恤
  659 + - #5 [L3] spu=61764 Aelfric Eden 90s Oversized T Shirts Unisex Grahpic Jersey Printed Casual Tees Streetwear Vintage Summer Top Tshirt (rel=217.47078)
  660 + zh: 艾尔弗里克·伊甸 90年代宽松印花针织休闲男女士圆领T恤 复古街头风 夏季上衣 T恤
  661 +
  662 +### office casual blouse
  663 +
  664 +- Primary_Metric_Score: 0.856879
  665 +- NDCG@20: 1.0
  666 +- NDCG@50: 0.88707
  667 +- ERR@10: 0.93472
  668 +- Strong_Precision@10: 1.0
  669 +- Strong_Precision@20: 1.0
  670 +- Useful_Precision@50: 1.0
  671 +- Avg_Grade@10: 3.0
  672 +- Gain_Recall@20: 0.033241
  673 +- ERR@10: 0.93472
  674 +- ERR@20: 0.93472
  675 +- ERR@5: 0.934715
  676 +- ERR@50: 0.93472
  677 +- Exact_Precision@10: 1.0
  678 +- Exact_Precision@20: 1.0
  679 +- Exact_Precision@5: 1.0
  680 +- Exact_Success@10: 1.0
  681 +- Exact_Success@5: 1.0
  682 +- Gain_Recall@10: 0.01662
  683 +- Gain_Recall@50: 0.07036
  684 +- MRR_Exact@10: 1.0
  685 +- MRR_Strong@10: 1.0
  686 +- NDCG@10: 1.0
  687 +- NDCG@5: 1.0
  688 +- Strong_Precision@5: 1.0
  689 +- Strong_Success@10: 1.0
  690 +- Strong_Success@5: 1.0
  691 +- Useful_Precision@10: 1.0
  692 +- Useful_Precision@20: 1.0
  693 +- Fully Relevant: 42
  694 +- Mostly Relevant: 36
  695 +- Weakly Relevant: 18
  696 +- Irrelevant: 4
  697 +- Request ID: `0578be4f`
  698 +- Top-10 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L3 | 6:L3 | 7:L3 | 8:L3 | 9:L3 | 10:L3`
  699 +- Top-20 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L3 | 6:L3 | 7:L3 | 8:L3 | 9:L3 | 10:L3 | 11:L3 | 12:L3 | 13:L3 | 14:L3 | 15:L3 | 16:L3 | 17:L3 | 18:L3 | 19:L3 | 20:L3`
  700 +- Case Snapshot:
  701 + - #1 [L3] spu=67325 Womens Long Sleeve Button Down Shirt Ultra-Soft Stretch Wrinkle-Free Work Casual Business Office Blouse (rel=155.698)
  702 + zh: 女式长袖扣领衬衫 超柔弹力抗皱 通勤休闲商务办公上衣
  703 + - #2 [L3] spu=61967 Timeson Women's Short Sleeve Chiffon Blouses for Office Work Business Attire Collared Shirts (rel=154.15936)
  704 + zh: Timeson 女士短袖雪纺衬衫办公商务正装立领衬衫
  705 + - #3 [L3] spu=63888 HOTOUCH Women Oversized Button Down Shirts Office Drop Shoulder Blouse Long Sleeve Boyfriend Dress Shirt with Pockets (rel=170.09383)
  706 + zh: HOTOUCH 女士宽松扣钮衬衫 办公室落肩设计长袖男友风连衣衬衫 附口袋
  707 + - #4 [L3] spu=62426 Timeson Women's 3/4 Sleeve Tops Dressy Casual Business Work Blouses Chiffon Office Shirts (rel=197.24539)
  708 + zh: Timeson 女士3/4袖连衣裙式商务休闲工作衬衫 雪纺办公上衣
  709 + - #5 [L3] spu=66683 Floerns Women's Elegant Flare Long Sleeve Shirts Button Down Business Casual Work Blouse (rel=111.183975)
  710 + zh: Floerns 女士优雅喇叭袖长袖衬衫 休闲商务工作衬衣
  711 +
  712 +### 波西米亚花朵衬衫
  713 +
  714 +- Primary_Metric_Score: 0.632907
  715 +- NDCG@20: 0.744398
  716 +- NDCG@50: 0.596082
  717 +- ERR@10: 0.920072
  718 +- Strong_Precision@10: 0.7
  719 +- Strong_Precision@20: 0.7
  720 +- Useful_Precision@50: 0.72
  721 +- Avg_Grade@10: 1.9
  722 +- Gain_Recall@20: 0.049369
  723 +- ERR@10: 0.920072
  724 +- ERR@20: 0.920073
  725 +- ERR@5: 0.919952
  726 +- ERR@50: 0.920073
  727 +- Exact_Precision@10: 0.5
  728 +- Exact_Precision@20: 0.6
  729 +- Exact_Precision@5: 0.6
  730 +- Exact_Success@10: 1.0
  731 +- Exact_Success@5: 1.0
  732 +- Gain_Recall@10: 0.021814
  733 +- Gain_Recall@50: 0.079219
  734 +- MRR_Exact@10: 1.0
  735 +- MRR_Strong@10: 1.0
  736 +- NDCG@10: 0.707981
  737 +- NDCG@5: 0.872145
  738 +- Strong_Precision@5: 1.0
  739 +- Strong_Success@10: 1.0
  740 +- Strong_Success@5: 1.0
  741 +- Useful_Precision@10: 0.7
  742 +- Useful_Precision@20: 0.85
  743 +- Fully Relevant: 22
  744 +- Mostly Relevant: 3
  745 +- Weakly Relevant: 42
  746 +- Irrelevant: 33
  747 +- Request ID: `34bd6122`
  748 +- Top-10 Labels: `1:L3 | 2:L2 | 3:L2 | 4:L3 | 5:L3 | 6:L3 | 7:L0 | 8:L0 | 9:L0 | 10:L3`
  749 +- Top-20 Labels: `1:L3 | 2:L2 | 3:L2 | 4:L3 | 5:L3 | 6:L3 | 7:L0 | 8:L0 | 9:L0 | 10:L3 | 11:L3 | 12:L3 | 13:L3 | 14:L3 | 15:L1 | 16:L3 | 17:L3 | 18:L3 | 19:L1 | 20:L1`
  750 +- Case Snapshot:
  751 + - #1 [L3] spu=64146 KAYWIDE Women's Casual Boho V Neck Top Loose Floral Printed Long Sleeve Beach Shirts Blouses (rel=348.44418)
  752 + zh: KAYWIDE 女士休闲波西米亚风V领长袖印花沙滩衬衫上衣
  753 + - #2 [L2] spu=64038 Grosy Bohemian Embroidered Tops for Women, Hippie Clothes, Mexican Peasant Blouses, Traditional Boho Clothing Tunic Shirts (rel=348.82568)
  754 + zh: Grosy波西米亚刺绣女衫，嬉皮士风格服饰，墨西哥乡村女式衬衫，传统波西米亚长袖上衣
  755 + - #3 [L2] spu=65712 Grosy Bohemian Embroidered Tops for Women, Hippie Clothes, Mexican Peasant Blouses, Traditional Boho Clothing Tunic Shirts (rel=348.82568)
  756 + zh: Grosy波西米亚刺绣女衫，嬉皮士风格服饰，墨西哥乡村女式衬衫，传统波西米亚长袖上衣
  757 + - #4 [L3] spu=63214 Women's Casual Floral Blouse Batwing Sleeve Loose Fitting Shirts Boho Knot Front Tops (rel=357.55646)
  758 + zh: 女式休闲花卉衬衫 波西米亚风绑带前襟蝙蝠袖宽松上衣
  759 + - #5 [L3] spu=63693 Grosy Womens Casual Summer Tops, Hippie Clothes, Traditional Floral Embroidered Boho Shirt, Mexican Peasant Blouses for Women (rel=379.176)
  760 + zh: Grosy 女士休闲夏季上衣，波西米亚风格服饰，传统花卉刺绣波西米亚衬衫，墨西哥乡村风女式罩衫
  761 +
  762 +### 泡泡袖短袖
  763 +
  764 +- Primary_Metric_Score: 0.769691
  765 +- NDCG@20: 0.849822
  766 +- NDCG@50: 0.717397
  767 +- ERR@10: 0.93472
  768 +- Strong_Precision@10: 1.0
  769 +- Strong_Precision@20: 0.75
  770 +- Useful_Precision@50: 0.86
  771 +- Avg_Grade@10: 3.0
  772 +- Gain_Recall@20: 0.045587
  773 +- ERR@10: 0.93472
  774 +- ERR@20: 0.93472
  775 +- ERR@5: 0.934715
  776 +- ERR@50: 0.93472
  777 +- Exact_Precision@10: 1.0
  778 +- Exact_Precision@20: 0.7
  779 +- Exact_Precision@5: 1.0
  780 +- Exact_Success@10: 1.0
  781 +- Exact_Success@5: 1.0
  782 +- Gain_Recall@10: 0.029098
  783 +- Gain_Recall@50: 0.077595
  784 +- MRR_Exact@10: 1.0
  785 +- MRR_Strong@10: 1.0
  786 +- NDCG@10: 1.0
  787 +- NDCG@5: 1.0
  788 +- Strong_Precision@5: 1.0
  789 +- Strong_Success@10: 1.0
  790 +- Strong_Success@5: 1.0
  791 +- Useful_Precision@10: 1.0
  792 +- Useful_Precision@20: 0.9
  793 +- Fully Relevant: 16
  794 +- Mostly Relevant: 18
  795 +- Weakly Relevant: 42
  796 +- Irrelevant: 24
  797 +- Request ID: `5ed0b7ab`
  798 +- Top-10 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L3 | 6:L3 | 7:L3 | 8:L3 | 9:L3 | 10:L3`
  799 +- Top-20 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L3 | 6:L3 | 7:L3 | 8:L3 | 9:L3 | 10:L3 | 11:L3 | 12:L3 | 13:L3 | 14:L0 | 15:L1 | 16:L0 | 17:L1 | 18:L3 | 19:L1 | 20:L2`
  800 +- Case Snapshot:
  801 + - #1 [L3] spu=69079 Women's White Short Sleeve T-Shirt, Designers' Unique Summer Top, Sweet Relaxed Fit, Puff Sleeves, Petite Friendly, Versatile, Insta-Chic (rel=357.64008)
  802 + zh: 白色短袖T恤女设计感小众夏装百搭甜美正肩泡泡袖小个子上衣ins潮
  803 + - #2 [L3] spu=68163 Chiffon Bubble-Sleeve Top, Women's Summer 2026 New Short-Sleeve Boho Design, French-style Mini Shirt (rel=256.32385)
  804 + zh: 泡泡袖雪纺上衣女夏季2026新款短袖设计感小众短款上衣法式娃娃衫
  805 + - #3 [L3] spu=65862 Women's Button Down Shirts Short Sleeve Puff Blouse Basic Tailored Fit Casual & Work Top (rel=210.53845)
  806 + zh: 女式纽扣衬衫 短袖泡泡袖 基础剪裁 休闲通勤上衣
  807 + - #4 [L3] spu=67936 South Korea Chic Sweetheart Big Miss Sweet Grab Pleated Line Big Square Collar Bubble Sleeve Shirt (rel=199.82608)
  808 + zh: 韩国时尚心形领大露背甜美褶皱方领泡泡袖衬衫
  809 + - #5 [L3] spu=68045 2026 Summer Little Chanel-style Chiffon Top, Fashionable Women's Short Sleeve Lace V-Neck Puff Sleeve Shirt, Trendy (rel=197.22339)
  810 + zh: 2026夏季小香风雪纺衫时尚百搭女短袖上衣蕾丝V领泡泡袖上衣潮
  811 +
  812 +### 扎染字母T恤
  813 +
  814 +- Primary_Metric_Score: 0.444455
  815 +- NDCG@20: 0.604846
  816 +- NDCG@50: 0.539865
  817 +- ERR@10: 0.897221
  818 +- Strong_Precision@10: 0.1
  819 +- Strong_Precision@20: 0.1
  820 +- Useful_Precision@50: 0.88
  821 +- Avg_Grade@10: 1.2
  822 +- Gain_Recall@20: 0.033708
  823 +- ERR@10: 0.897221
  824 +- ERR@20: 0.899657
  825 +- ERR@5: 0.892454
  826 +- ERR@50: 0.899713
  827 +- Exact_Precision@10: 0.1
  828 +- Exact_Precision@20: 0.1
  829 +- Exact_Precision@5: 0.2
  830 +- Exact_Success@10: 1.0
  831 +- Exact_Success@5: 1.0
  832 +- Gain_Recall@10: 0.016854
  833 +- Gain_Recall@50: 0.071629
  834 +- MRR_Exact@10: 1.0
  835 +- MRR_Strong@10: 1.0
  836 +- NDCG@10: 0.610518
  837 +- NDCG@5: 0.657354
  838 +- Strong_Precision@5: 0.2
  839 +- Strong_Success@10: 1.0
  840 +- Strong_Success@5: 1.0
  841 +- Useful_Precision@10: 1.0
  842 +- Useful_Precision@20: 1.0
  843 +- Fully Relevant: 2
  844 +- Mostly Relevant: 6
  845 +- Weakly Relevant: 79
  846 +- Irrelevant: 13
  847 +- Request ID: `877ba8f8`
  848 +- Top-10 Labels: `1:L3 | 2:L1 | 3:L1 | 4:L1 | 5:L1 | 6:L1 | 7:L1 | 8:L1 | 9:L1 | 10:L1`
  849 +- Top-20 Labels: `1:L3 | 2:L1 | 3:L1 | 4:L1 | 5:L1 | 6:L1 | 7:L1 | 8:L1 | 9:L1 | 10:L1 | 11:L1 | 12:L1 | 13:L1 | 14:L1 | 15:L1 | 16:L1 | 17:L1 | 18:L1 | 19:L3 | 20:L1`
  850 +- Case Snapshot:
  851 + - #1 [L3] spu=69148 American Style Vintage Tie-Dye Short-Sleeved Letter Printed Loose Women's T-Shirt 2025 Summer Design Sense Short Student Top (rel=406.54242)
  852 + zh: 美式复古扎染字母印花宽松短袖女式T恤2025夏季设计感学生上衣
  853 + - #2 [L1] spu=67166 Remidoo Women's Tie Dye Short Sleeve Tee Crewneck Summer T Shirt Multicolor (rel=324.61823)
  854 + zh: Remidoo 女士扎染短袖圆领夏季多色T恤
  855 + - #3 [L1] spu=69384 Remidoo Women's Tie Dye Short Sleeve Tee Crewneck Summer T Shirt Multicolor (rel=323.83374)
  856 + zh: Remidoo 女士扎染短袖圆领夏季多色T恤
  857 + - #4 [L1] spu=69105 American Style Retro Pure Cotton Heavy-duty Short-sleeved T-shirt Women's Summer New Design Sense Letter Printed Loose Slim-fit Top (rel=246.38802)
  858 + zh: 美式复古纯棉加厚短袖T恤 女士夏季新款字母印花宽松显瘦上衣
  859 + - #5 [L1] spu=60584 Teach T Shirt for Women Teacher Graphic Tees Tops Teach Inspire Letter Print Shirts Tops (rel=281.76917)
  860 + zh: 女教师教学励志字母印花T恤上衣
  861 +
  862 +### V-Neck Cotton T-shirt
  863 +
  864 +- Primary_Metric_Score: 0.785072
  865 +- NDCG@20: 0.874015
  866 +- NDCG@50: 0.733466
  867 +- ERR@10: 0.93472
  868 +- Strong_Precision@10: 1.0
  869 +- Strong_Precision@20: 1.0
  870 +- Useful_Precision@50: 0.8
  871 +- Avg_Grade@10: 2.7
  872 +- Gain_Recall@20: 0.038373
  873 +- ERR@10: 0.93472
  874 +- ERR@20: 0.93472
  875 +- ERR@5: 0.934715
  876 +- ERR@50: 0.93472
  877 +- Exact_Precision@10: 0.7
  878 +- Exact_Precision@20: 0.5
  879 +- Exact_Precision@5: 1.0
  880 +- Exact_Success@10: 1.0
  881 +- Exact_Success@5: 1.0
  882 +- Gain_Recall@10: 0.020721
  883 +- Gain_Recall@50: 0.072909
  884 +- MRR_Exact@10: 1.0
  885 +- MRR_Strong@10: 1.0
  886 +- NDCG@10: 0.933565
  887 +- NDCG@5: 1.0
  888 +- Strong_Precision@5: 1.0
  889 +- Strong_Success@10: 1.0
  890 +- Strong_Success@5: 1.0
  891 +- Useful_Precision@10: 1.0
  892 +- Useful_Precision@20: 1.0
  893 +- Fully Relevant: 23
  894 +- Mostly Relevant: 49
  895 +- Weakly Relevant: 7
  896 +- Irrelevant: 21
  897 +- Request ID: `77fffe76`
  898 +- Top-10 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L3 | 6:L3 | 7:L3 | 8:L2 | 9:L2 | 10:L2`
  899 +- Top-20 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L3 | 6:L3 | 7:L3 | 8:L2 | 9:L2 | 10:L2 | 11:L2 | 12:L2 | 13:L2 | 14:L3 | 15:L3 | 16:L2 | 17:L2 | 18:L3 | 19:L2 | 20:L2`
  900 +- Case Snapshot:
  901 + - #1 [L3] spu=60585 Ebifin Womens Oversized Tshirts V Neck Tee Shirts Half Sleeve Loose Fit T Shirt Cotton Tunic Tops 2025 (rel=433.17346)
  902 + zh: Ebifin 女士宽松V领短袖纯棉上衣 2025新款
  903 + - #2 [L3] spu=60725 True Classic Mens V Neck T Shirts - Cotton V Neck Shirts for Men, V-Neck Mens T-Shirts and Undershirts for Men Pack/Singles (rel=394.05435)
  904 + zh: 男士经典纯棉V领T恤 - 男式V领T恤及内衣单件/套装
  905 + - #3 [L3] spu=61487 Women's Plus Size V Neck T Shirts Summer Half Sleeve Tees Casual Loose Fit Cotton Tunic Tops (rel=328.7702)
  906 + zh: 女装加大码V领短袖T恤 夏季宽松纯棉连身裙式上衣
  907 + - #4 [L3] spu=69138 Shijian Owner's Favorite, Elegant V-Neck Short Sleeve Cotton T-Shirt, Soft Pure Cotton, Spring 2026 New Arrival, Style No. 40275 (rel=466.15814)
  908 + zh: 时简 店主私服挚爱 精致V领短袖T恤纯棉亲肤2026春新款上衣40275
  909 + - #5 [L3] spu=65022 MAGCOMSEN Women's Cotton T Shirt V-Neck Short Sleeve Shirt Classic-Fit Casual Breathable Tee Summer Basic Tops (rel=338.40048)
  910 + zh: MAGCOMSEN 女士纯棉V领短袖T恤 修身休闲透气夏装基础款上衣
  911 +
  912 +### Athletic Gym T-shirt
  913 +
  914 +- Primary_Metric_Score: 0.774099
  915 +- NDCG@20: 0.842827
  916 +- NDCG@50: 0.72382
  917 +- ERR@10: 0.93472
  918 +- Strong_Precision@10: 1.0
  919 +- Strong_Precision@20: 0.8
  920 +- Useful_Precision@50: 0.92
  921 +- Avg_Grade@10: 2.8
  922 +- Gain_Recall@20: 0.038088
  923 +- ERR@10: 0.93472
  924 +- ERR@20: 0.93472
  925 +- ERR@5: 0.934715
  926 +- ERR@50: 0.93472
  927 +- Exact_Precision@10: 0.8
  928 +- Exact_Precision@20: 0.6
  929 +- Exact_Precision@5: 1.0
  930 +- Exact_Success@10: 1.0
  931 +- Exact_Success@5: 1.0
  932 +- Gain_Recall@10: 0.02269
  933 +- Gain_Recall@50: 0.072934
  934 +- MRR_Exact@10: 1.0
  935 +- MRR_Strong@10: 1.0
  936 +- NDCG@10: 0.953461
  937 +- NDCG@5: 1.0
  938 +- Strong_Precision@5: 1.0
  939 +- Strong_Success@10: 1.0
  940 +- Strong_Success@5: 1.0
  941 +- Useful_Precision@10: 1.0
  942 +- Useful_Precision@20: 0.95
  943 +- Fully Relevant: 18
  944 +- Mostly Relevant: 19
  945 +- Weakly Relevant: 47
  946 +- Irrelevant: 16
  947 +- Request ID: `ea00d4bd`
  948 +- Top-10 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L3 | 6:L3 | 7:L2 | 8:L3 | 9:L2 | 10:L3`
  949 +- Top-20 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L3 | 6:L3 | 7:L2 | 8:L3 | 9:L2 | 10:L3 | 11:L3 | 12:L3 | 13:L1 | 14:L1 | 15:L2 | 16:L3 | 17:L1 | 18:L2 | 19:L3 | 20:L0`
  950 +- Case Snapshot:
  951 + - #1 [L3] spu=69385 Workout Shirts for Men Short Sleeve Quick Dry Athletic Gym Active T Shirt Moisture Wicking (rel=419.76852)
  952 + zh: 男士短袖速干运动健身T恤 透气吸湿
  953 + - #2 [L3] spu=67138 Workout Shirts for Men Short Sleeve Quick Dry Athletic Gym Active T Shirt Moisture Wicking (rel=419.76852)
  954 + zh: 男士短袖速干运动健身T恤 透气吸湿
  955 + - #3 [L3] spu=61172 Workout Shirts for Men Short Sleeve Quick Dry Athletic Gym Active T Shirt Moisture Wicking (rel=416.26065)
  956 + zh: 男士短袖速干运动健身T恤 透气吸湿
  957 + - #4 [L3] spu=69247 Hanes Sport Women's Cool DRI Performance T-Shirt, Short Sleeve, Moisture-Wicking, UPF 40+, Lightweight Athletic Fit Tee for Running, Gym, Workout, Training, Sublimation-Ready, Black, Medium (rel=237.22246)
  958 + zh: Hanes 女士运动系列清凉吸湿速干短袖T恤，防晒UPF40+，轻盈运动版型，适合跑步、健身、训练，可定制印花，黑色，中号
  959 + - #5 [L3] spu=66975 Hanes Sport Women's Cool DRI Performance T-Shirt, Short Sleeve, Moisture-Wicking, UPF 40+, Lightweight Athletic Fit Tee for Running, Gym, Workout, Training, Sublimation-Ready, Black, Medium (rel=237.22246)
  960 + zh: Hanes 女士运动系列清凉吸湿速干短袖T恤，防晒UPF40+，轻盈运动版型，适合跑步、健身、训练，可定制印花，黑色，中号
  961 +
  962 +### Plus Size Loose T-shirt
  963 +
  964 +- Primary_Metric_Score: 0.707451
  965 +- NDCG@20: 0.716907
  966 +- NDCG@50: 0.716266
  967 +- ERR@10: 0.933604
  968 +- Strong_Precision@10: 0.8
  969 +- Strong_Precision@20: 0.75
  970 +- Useful_Precision@50: 0.98
  971 +- Avg_Grade@10: 2.2
  972 +- Gain_Recall@20: 0.029499
  973 +- ERR@10: 0.933604
  974 +- ERR@20: 0.933606
  975 +- ERR@5: 0.933457
  976 +- ERR@50: 0.933606
  977 +- Exact_Precision@10: 0.4
  978 +- Exact_Precision@20: 0.25
  979 +- Exact_Precision@5: 0.6
  980 +- Exact_Success@10: 1.0
  981 +- Exact_Success@5: 1.0
  982 +- Gain_Recall@10: 0.016224
  983 +- Gain_Recall@50: 0.077434
  984 +- MRR_Exact@10: 1.0
  985 +- MRR_Strong@10: 1.0
  986 +- NDCG@10: 0.780173
  987 +- NDCG@5: 0.843212
  988 +- Strong_Precision@5: 0.8
  989 +- Strong_Success@10: 1.0
  990 +- Strong_Success@5: 1.0
  991 +- Useful_Precision@10: 1.0
  992 +- Useful_Precision@20: 1.0
  993 +- Fully Relevant: 29
  994 +- Mostly Relevant: 43
  995 +- Weakly Relevant: 22
  996 +- Irrelevant: 6
  997 +- Request ID: `ab93b1b4`
  998 +- Top-10 Labels: `1:L3 | 2:L3 | 3:L1 | 4:L3 | 5:L2 | 6:L2 | 7:L2 | 8:L1 | 9:L3 | 10:L2`
  999 +- Top-20 Labels: `1:L3 | 2:L3 | 3:L1 | 4:L3 | 5:L2 | 6:L2 | 7:L2 | 8:L1 | 9:L3 | 10:L2 | 11:L1 | 12:L2 | 13:L2 | 14:L3 | 15:L2 | 16:L2 | 17:L2 | 18:L1 | 19:L2 | 20:L1`
  1000 +- Case Snapshot:
  1001 + - #1 [L3] spu=63820 Women's Plus Size Tops Long Sleeve Crew Neck Oversized T Shirts Loose Casual Tunics (rel=294.25415)
  1002 + zh: 女式加大码长袖圆领宽松休闲连帽T恤
  1003 + - #2 [L3] spu=61708 Women Oversized T-Shirt Summer Casual Short Sleeve Loose Tee Tops (rel=198.29817)
  1004 + zh: 女式夏季宽松休闲短袖衬衫上衣
  1005 + - #3 [L1] spu=63753 Womens Plus Size Tank Tops Summer Sleeveless Henley T-Shirts Tops Casual Button Down Tunics Shirts (rel=278.0347)
  1006 + zh: 女装加大码夏装无袖亨利领短袖上衣 休闲纽扣开衫连身裙衫
  1007 + - #4 [L3] spu=67712 Plus Size Women's Country Concert Outfits V Neck Western Cowgirl Cowboy Shirts Vintage Graphic Tees Casual Summer Tops (rel=223.07294)
  1008 + zh: 大码女士乡村音乐会服饰 一字领西部牛仔风格女式衬衫 复古印花T恤 休闲夏季上衣
  1009 + - #5 [L2] spu=64439 Plus Size Thanksgiving Shirts Women Thankful Grateful Blessed Shirt Leopard Pumpkin Print Casual Fall Tops (rel=185.01407)
  1010 + zh: 加大码感恩节女士衬衫 感恩知足吉祥豹纹南瓜印花休闲秋季上衣
  1011 +
  1012 +### Korean Style Slim T-shirt
  1013 +
  1014 +- Primary_Metric_Score: 0.831559
  1015 +- NDCG@20: 0.936759
  1016 +- NDCG@50: 0.857693
  1017 +- ERR@10: 0.934719
  1018 +- Strong_Precision@10: 1.0
  1019 +- Strong_Precision@20: 0.95
  1020 +- Useful_Precision@50: 1.0
  1021 +- Avg_Grade@10: 2.8
  1022 +- Gain_Recall@20: 0.039971
  1023 +- ERR@10: 0.934719
  1024 +- ERR@20: 0.934719
  1025 +- ERR@5: 0.934715
  1026 +- ERR@50: 0.934719
  1027 +- Exact_Precision@10: 0.8
  1028 +- Exact_Precision@20: 0.8
  1029 +- Exact_Precision@5: 1.0
  1030 +- Exact_Success@10: 1.0
  1031 +- Exact_Success@5: 1.0
  1032 +- Gain_Recall@10: 0.020349
  1033 +- Gain_Recall@50: 0.08939
  1034 +- MRR_Exact@10: 1.0
  1035 +- MRR_Strong@10: 1.0
  1036 +- NDCG@10: 0.95266
  1037 +- NDCG@5: 1.0
  1038 +- Strong_Precision@5: 1.0
  1039 +- Strong_Success@10: 1.0
  1040 +- Strong_Success@5: 1.0
  1041 +- Useful_Precision@10: 1.0
  1042 +- Useful_Precision@20: 1.0
  1043 +- Fully Relevant: 57
  1044 +- Mostly Relevant: 21
  1045 +- Weakly Relevant: 19
  1046 +- Irrelevant: 3
  1047 +- Request ID: `c2aa3be1`
  1048 +- Top-10 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L3 | 6:L2 | 7:L3 | 8:L3 | 9:L3 | 10:L2`
  1049 +- Top-20 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L3 | 6:L2 | 7:L3 | 8:L3 | 9:L3 | 10:L2 | 11:L3 | 12:L3 | 13:L3 | 14:L3 | 15:L3 | 16:L3 | 17:L3 | 18:L3 | 19:L1 | 20:L2`
  1050 +- Case Snapshot:
  1051 + - #1 [L3] spu=69081 Mesh Bottoming Shirt Women's Long-Sleeved T-Shirt 2025 Autumn and Winter New Korean Style Round Neck Slim Shirt with Tight Top (rel=520.06494)
  1052 + zh: 女式网眼打底长袖T恤 2025秋冬新款韩版圆领修身短款上衣
  1053 + - #2 [L3] spu=69125 200g Pure Cotton Short-Sleeve T-Shirt for Women, Korean Style Unisex Couple Half-Sleeve Versatile T-Shirt, Thick Sweater (rel=295.8727)
  1054 + zh: 200克纯棉女士短袖T恤，韩版男女通用情侣半袖百搭T恤，加厚针织衫
  1055 + - #3 [L3] spu=69118 Women's T-Shirt 2025 Summer Korean Style Black Off-Shoulder Strap Short-Sleeve T-Shirt Women's Off-Shoulder Sexy Top Trendy (rel=289.88028)
  1056 + zh: 女式2025夏季韩版黑色露肩一字肩短袖T恤露肩性感上衣潮流款
  1057 + - #4 [L3] spu=68077 Summer New Foreign Trade Red Short-sleeved T-shirt Women's Base Shirt Women's Korean-style Slim-fit Spice Girl Inner Top Clothes (rel=284.40973)
  1058 + zh: 夏季新款外贸红色短袖女衫 女式韩版修身辣妹内搭上衣
  1059 + - #5 [L3] spu=69111 Japanese and Korean pure cotton white T-shirt women's short-sleeved summer new slim thin bottoming shirt with solid color slimming top. (rel=218.18573)
  1060 + zh: 日韩纯棉白色女式短袖夏装修身打底衫，纯色显瘦上衣
  1061 +
  1062 +### Basic Layering Top
  1063 +
  1064 +- Primary_Metric_Score: 0.786547
  1065 +- NDCG@20: 0.875623
  1066 +- NDCG@50: 0.866635
  1067 +- ERR@10: 0.93472
  1068 +- Strong_Precision@10: 0.9
  1069 +- Strong_Precision@20: 0.85
  1070 +- Useful_Precision@50: 0.98
  1071 +- Avg_Grade@10: 2.6
  1072 +- Gain_Recall@20: 0.018734
  1073 +- ERR@10: 0.93472
  1074 +- ERR@20: 0.93472
  1075 +- ERR@5: 0.934715
  1076 +- ERR@50: 0.93472
  1077 +- Exact_Precision@10: 0.8
  1078 +- Exact_Precision@20: 0.7
  1079 +- Exact_Precision@5: 1.0
  1080 +- Exact_Success@10: 1.0
  1081 +- Exact_Success@5: 1.0
  1082 +- Gain_Recall@10: 0.009741
  1083 +- Gain_Recall@50: 0.047583
  1084 +- MRR_Exact@10: 1.0
  1085 +- MRR_Strong@10: 1.0
  1086 +- NDCG@10: 0.913235
  1087 +- NDCG@5: 1.0
  1088 +- Strong_Precision@5: 1.0
  1089 +- Strong_Success@10: 1.0
  1090 +- Strong_Success@5: 1.0
  1091 +- Useful_Precision@10: 0.9
  1092 +- Useful_Precision@20: 0.95
  1093 +- Fully Relevant: 70
  1094 +- Mostly Relevant: 12
  1095 +- Weakly Relevant: 15
  1096 +- Irrelevant: 3
  1097 +- Request ID: `aba3c9da`
  1098 +- Top-10 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L3 | 6:L3 | 7:L3 | 8:L2 | 9:L3 | 10:L0`
  1099 +- Top-20 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L3 | 6:L3 | 7:L3 | 8:L2 | 9:L3 | 10:L0 | 11:L3 | 12:L2 | 13:L3 | 14:L2 | 15:L3 | 16:L3 | 17:L3 | 18:L3 | 19:L1 | 20:L1`
  1100 +- Case Snapshot:
  1101 + - #1 [L3] spu=65715 Womens Boat Neck Seamless Tank Tops Sleeveless Double Layering Shirts Basic Going Out Tops Summer Outfits (rel=163.19257)
  1102 + zh: 女士无袖一体式荷叶边吊带上衣 两件套基础款外出上衣 夏季穿搭
  1103 + - #2 [L3] spu=69276 iGENJUN Womens Spaghetti Strap V-Neck Ribbed Tank Tops for Women 2026 Slim Fitted Soft Camisole Basic Layering Shirts (rel=147.5171)
  1104 + zh: iGENJUN 女士细肩带V领螺纹背心吊带上衣 2026款修身柔软基础叠穿短袖上衣
  1105 + - #3 [L3] spu=67018 iGENJUN Womens Spaghetti Strap V-Neck Ribbed Tank Tops for Women 2026 Slim Fitted Soft Camisole Basic Layering Shirts (rel=147.5171)
  1106 + zh: iGENJUN 女士细肩带V领螺纹背心吊带上衣 2026款修身柔软基础叠穿短袖上衣
  1107 + - #4 [L3] spu=62139 GEMBERA Women Spaghetti Strap Scoop Neck Ribbed Tank Tops Slim Fitted Cotton Camisole Basic Sleeveless Layering Shirts (rel=145.0882)
  1108 + zh: GEMBERA 女士细肩带圆领螺纹吊带上衣 修身棉质背心 基础款无袖叠穿衬衫
  1109 + - #5 [L3] spu=69161 New Women's V-Neck Long-Sleeve T-Shirt, Slim Fit Milk Silk Basic Top, Elegant Inner Layer (rel=142.59929)
  1110 + zh: 新款欧美女装v领t恤显瘦长袖上衣修身型牛奶丝打底衫女高级感内搭
  1111 +
  1112 +### shawl collar cardigan
  1113 +
  1114 +- Primary_Metric_Score: 0.459655
  1115 +- NDCG@20: 0.598929
  1116 +- NDCG@50: 0.62579
  1117 +- ERR@10: 0.535496
  1118 +- Strong_Precision@10: 0.3
  1119 +- Strong_Precision@20: 0.15
  1120 +- Useful_Precision@50: 0.8
  1121 +- Avg_Grade@10: 1.6
  1122 +- Gain_Recall@20: 0.13369
  1123 +- ERR@10: 0.535496
  1124 +- ERR@20: 0.535535
  1125 +- ERR@5: 0.535398
  1126 +- ERR@50: 0.535544
  1127 +- Exact_Precision@10: 0.3
  1128 +- Exact_Precision@20: 0.15
  1129 +- Exact_Precision@5: 0.6
  1130 +- Exact_Success@10: 1.0
  1131 +- Exact_Success@5: 1.0
  1132 +- Gain_Recall@10: 0.085561
  1133 +- Gain_Recall@50: 0.272727
  1134 +- MRR_Exact@10: 0.5
  1135 +- MRR_Strong@10: 0.5
  1136 +- NDCG@10: 0.66326
  1137 +- NDCG@5: 0.728138
  1138 +- Strong_Precision@5: 0.6
  1139 +- Strong_Success@10: 1.0
  1140 +- Strong_Success@5: 1.0
  1141 +- Useful_Precision@10: 1.0
  1142 +- Useful_Precision@20: 0.95
  1143 +- Fully Relevant: 3
  1144 +- Mostly Relevant: 10
  1145 +- Weakly Relevant: 58
  1146 +- Irrelevant: 29
  1147 +- Request ID: `165641b9`
  1148 +- Top-10 Labels: `1:L1 | 2:L3 | 3:L1 | 4:L3 | 5:L3 | 6:L1 | 7:L1 | 8:L1 | 9:L1 | 10:L1`
  1149 +- Top-20 Labels: `1:L1 | 2:L3 | 3:L1 | 4:L3 | 5:L3 | 6:L1 | 7:L1 | 8:L1 | 9:L1 | 10:L1 | 11:L1 | 12:L1 | 13:L1 | 14:L1 | 15:L1 | 16:L1 | 17:L1 | 18:L1 | 19:L1 | 20:L0`
  1150 +- Case Snapshot:
  1151 + - #1 [L1] spu=63020 Bestshe Women's Boho Open Front Poncho Knitted Plaid Shawl Wrap Cape Tassel Cardigan Sweater (rel=220.51793)
  1152 + zh: Bestshe 女士波西米亚开襟针织格纹披肩斗篷流苏开衫外套
  1153 + - #2 [L3] spu=64329 JMIERR Men's Casual Wool Blend Cardigan Sweaters Long Sleeve Shawl Collar Buttons Down Cable Knit Sweater (rel=268.05896)
  1154 + zh: JMIERR 男款休闲羊毛混纺开衫毛衣 长袖披肩领扣扣编织针织衫
  1155 + - #3 [L1] spu=68142 Solid Color free size Shade Mesh European and American Street Pastoral Women's Front Top Shawl Small Cardigan with Sleeves (rel=187.27066)
  1156 + zh: 纯色系可调节尺寸欧美元素田园风女士前开式带袖小披肩马甲
  1157 + - #4 [L3] spu=67375 Belle Poque Women Vintage Cardigan Sweater Shawl Lapel Button Down Sweater Outwear Coat (rel=234.14084)
  1158 + zh: Belle Poque 女士复古开襟针织开衫披肩翻领扣扣外套
  1159 + - #5 [L3] spu=61497 Belle Poque Women Vintage Cardigan Sweater Shawl Lapel Button Down Sweater Outwear Coat (rel=233.18271)
  1160 + zh: Belle Poque 女士复古开襟针织开衫披肩翻领扣扣外套
  1161 +
  1162 +### swim dress
  1163 +
  1164 +- Primary_Metric_Score: 0.708603
  1165 +- NDCG@20: 0.749045
  1166 +- NDCG@50: 0.628698
  1167 +- ERR@10: 0.93472
  1168 +- Strong_Precision@10: 1.0
  1169 +- Strong_Precision@20: 0.55
  1170 +- Useful_Precision@50: 0.72
  1171 +- Avg_Grade@10: 3.0
  1172 +- Gain_Recall@20: 0.086364
  1173 +- ERR@10: 0.93472
  1174 +- ERR@20: 0.93472
  1175 +- ERR@5: 0.934715
  1176 +- ERR@50: 0.93472
  1177 +- Exact_Precision@10: 1.0
  1178 +- Exact_Precision@20: 0.55
  1179 +- Exact_Precision@5: 1.0
  1180 +- Exact_Success@10: 1.0
  1181 +- Exact_Success@5: 1.0
  1182 +- Gain_Recall@10: 0.068182
  1183 +- Gain_Recall@50: 0.143182
  1184 +- MRR_Exact@10: 1.0
  1185 +- MRR_Strong@10: 1.0
  1186 +- NDCG@10: 1.0
  1187 +- NDCG@5: 1.0
  1188 +- Strong_Precision@5: 1.0
  1189 +- Strong_Success@10: 1.0
  1190 +- Strong_Success@5: 1.0
  1191 +- Useful_Precision@10: 1.0
  1192 +- Useful_Precision@20: 0.8
  1193 +- Fully Relevant: 11
  1194 +- Mostly Relevant: 5
  1195 +- Weakly Relevant: 45
  1196 +- Irrelevant: 39
  1197 +- Request ID: `56737a37`
  1198 +- Top-10 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L3 | 6:L3 | 7:L3 | 8:L3 | 9:L3 | 10:L3`
  1199 +- Top-20 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L3 | 6:L3 | 7:L3 | 8:L3 | 9:L3 | 10:L3 | 11:L1 | 12:L1 | 13:L0 | 14:L1 | 15:L1 | 16:L1 | 17:L3 | 18:L0 | 19:L0 | 20:L0`
  1200 +- Case Snapshot:
  1201 + - #1 [L3] spu=67077 One Piece Swim Dress Swimsuits for Women Tummy Control Swimdress Skirt Bathing Suit (rel=269.54938)
  1202 + zh: 连体泳衣 女士收腹泳裙 泳装连衣裙
  1203 + - #2 [L3] spu=69390 One Piece Swim Dress Swimsuits for Women Tummy Control Swimdress Skirt Bathing Suit (rel=269.31693)
  1204 + zh: 连体泳衣 女士收腹泳裙 泳装连衣裙
  1205 + - #3 [L3] spu=62434 Blooming Jelly Women Plus Size Swim Dress Swimsuit One Piece Tummy Control Bathing Suits Modest Criss Cross Swim Suits (rel=270.20145)
  1206 + zh: 绽放凝胶女士加大码连体泳衣 修身收腹 恬静交叉设计泳装
  1207 + - #4 [L3] spu=67088 Blooming Jelly Women Plus Size Swim Dress Swimsuit One Piece Tummy Control Bathing Suits Modest Criss Cross Swim Suits (rel=270.20145)
  1208 + zh: 绽放凝胶女士加大码连体泳衣 修身收腹 恬静交叉设计泳装
  1209 + - #5 [L3] spu=62378 Blooming Jelly Women's Plus Size Bathing Suit One Piece Swim Dress Tummy Control Swimsuits Ruffle V Neck Swimwear (rel=243.59526)
  1210 + zh: 绽放蜜桃女士大码连体泳衣收腹泳裙荷叶边V领泳装
  1211 +
  1212 +### 毕业典礼定制西装
  1213 +
  1214 +- Primary_Metric_Score: 0.652587
  1215 +- NDCG@20: 0.816198
  1216 +- NDCG@50: 0.803154
  1217 +- ERR@10: 0.421698
  1218 +- Strong_Precision@10: 0.8
  1219 +- Strong_Precision@20: 0.7
  1220 +- Useful_Precision@50: 0.92
  1221 +- Avg_Grade@10: 1.7
  1222 +- Gain_Recall@20: 0.192982
  1223 +- ERR@10: 0.421698
  1224 +- ERR@20: 0.423282
  1225 +- ERR@5: 0.405487
  1226 +- ERR@50: 0.42331
  1227 +- Exact_Precision@10: 0.0
  1228 +- Exact_Precision@20: 0.0
  1229 +- Exact_Precision@5: 0.0
  1230 +- Exact_Success@10: 0.0
  1231 +- Exact_Success@5: 0.0
  1232 +- Gain_Recall@10: 0.099415
  1233 +- Gain_Recall@50: 0.362573
  1234 +- MRR_Exact@10: 0.0
  1235 +- MRR_Strong@10: 0.5
  1236 +- NDCG@10: 0.820523
  1237 +- NDCG@5: 0.83042
  1238 +- Strong_Precision@5: 0.8
  1239 +- Strong_Success@10: 1.0
  1240 +- Strong_Success@5: 1.0
  1241 +- Useful_Precision@10: 0.9
  1242 +- Useful_Precision@20: 0.95
  1243 +- Fully Relevant: 0
  1244 +- Mostly Relevant: 18
  1245 +- Weakly Relevant: 51
  1246 +- Irrelevant: 31
  1247 +- Request ID: `9e30c53f`
  1248 +- Top-10 Labels: `1:L1 | 2:L2 | 3:L2 | 4:L2 | 5:L2 | 6:L2 | 7:L2 | 8:L0 | 9:L2 | 10:L2`
  1249 +- Top-20 Labels: `1:L1 | 2:L2 | 3:L2 | 4:L2 | 5:L2 | 6:L2 | 7:L2 | 8:L0 | 9:L2 | 10:L2 | 11:L2 | 12:L2 | 13:L1 | 14:L2 | 15:L2 | 16:L2 | 17:L2 | 18:L1 | 19:L1 | 20:L1`
  1250 +- Case Snapshot:
  1251 + - #1 [L1] spu=62739 Barry.Wang Mens Casual Blazer Suit Jacket Two Buttons Sport Coat Lightweight Homecoming Business Daily Wedding Dress (rel=165.12125)
  1252 + zh: Barry.Wang 男式休闲西装外套 两粒扣 运动风 轻便 毕业典礼 商务 日常 婚礼正装
  1253 + - #2 [L2] spu=65531 Wangyue 3 Piece Men's Suits Slim Fit Suits for Men Wedding Prom Tuxedo Suits Formal Business (rel=115.983795)
  1254 + zh: 王跃三件套男士西装 修身版礼服西装 男式婚礼派对燕尾服 正式商务套装
  1255 + - #3 [L2] spu=66269 Wangyue 3 Piece Men's Suits Slim Fit Suits for Men Wedding Prom Tuxedo Suits Formal Business (rel=115.983795)
  1256 + zh: 王跃三件套男士西装 修身版礼服西装 男式婚礼派对燕尾服 正式商务套装
  1257 + - #4 [L2] spu=66416 WULFUL Men's 3 Piece Slim Fit Suit Set Two Button Blazer Jacket Vest Pants Tuxedo Set for Party, Wedding and Business (rel=107.01755)
  1258 + zh: WULFUL 男士三件套修身西装套装 两粒扣西装外套 领结背心 西裤 晚礼服套装 适用于派对 婚礼 商务场合
  1259 + - #5 [L2] spu=65357 WULFUL Men's 3 Piece Slim Fit Suit Set Two Button Blazer Jacket Vest Pants Tuxedo Set for Party, Wedding and Business (rel=107.01755)
  1260 + zh: WULFUL 男士三件套修身西装套装 两粒扣西装外套 领结背心 西裤 晚礼服套装 适用于派对 婚礼 商务场合
  1261 +
  1262 +### colorblock hoodie
  1263 +
  1264 +- Primary_Metric_Score: 0.193616
  1265 +- NDCG@20: 0.22893
  1266 +- NDCG@50: 0.269469
  1267 +- ERR@10: 0.296658
  1268 +- Strong_Precision@10: 0.1
  1269 +- Strong_Precision@20: 0.1
  1270 +- Useful_Precision@50: 0.38
  1271 +- Avg_Grade@10: 0.4
  1272 +- Gain_Recall@20: 0.040541
  1273 +- ERR@10: 0.296658
  1274 +- ERR@20: 0.329586
  1275 +- ERR@5: 0.289062
  1276 +- ERR@50: 0.331033
  1277 +- Exact_Precision@10: 0.0
  1278 +- Exact_Precision@20: 0.05
  1279 +- Exact_Precision@5: 0.0
  1280 +- Exact_Success@10: 0.0
  1281 +- Exact_Success@5: 0.0
  1282 +- Gain_Recall@10: 0.018018
  1283 +- Gain_Recall@50: 0.117117
  1284 +- MRR_Exact@10: 0.0
  1285 +- MRR_Strong@10: 0.5
  1286 +- NDCG@10: 0.220015
  1287 +- NDCG@5: 0.267406
  1288 +- Strong_Precision@5: 0.2
  1289 +- Strong_Success@10: 1.0
  1290 +- Strong_Success@5: 1.0
  1291 +- Useful_Precision@10: 0.3
  1292 +- Useful_Precision@20: 0.3
  1293 +- Fully Relevant: 3
  1294 +- Mostly Relevant: 6
  1295 +- Weakly Relevant: 33
  1296 +- Irrelevant: 58
  1297 +- Request ID: `7fda7292`
  1298 +- Top-10 Labels: `1:L1 | 2:L2 | 3:L0 | 4:L0 | 5:L0 | 6:L0 | 7:L0 | 8:L0 | 9:L1 | 10:L0`
  1299 +- Top-20 Labels: `1:L1 | 2:L2 | 3:L0 | 4:L0 | 5:L0 | 6:L0 | 7:L0 | 8:L0 | 9:L1 | 10:L0 | 11:L0 | 12:L0 | 13:L3 | 14:L0 | 15:L0 | 16:L0 | 17:L0 | 18:L0 | 19:L1 | 20:L1`
  1300 +- Case Snapshot:
  1301 + - #1 [L1] spu=66695 CHICGAL Sweatshirt for Women Long Sleeve Shirts Crewneck Color Block Loose Fit Pullover Fall Tops (rel=198.12358)
  1302 + zh: CHICGAL 女士长袖连帽衫 修身拼色宽松套头衫 秋季上衣
  1303 + - #2 [L2] spu=61548 PGANDS Womens Crew Neck Solid/Color Block Sweatshirts Long Sleeve Casual Lightweight Pullover Tops (rel=152.81213)
  1304 + zh: PGANDS 女士圆领纯色/拼色连帽卫衣 长袖休闲轻便套头上衣
  1305 + - #3 [L0] spu=67159 Hanes mens Zip-up Hoodie, Ecosmart Fleece Full-zip Hoodie for Men, Hooded Sweatshirt (rel=162.21922)
  1306 + zh: Hanes 男士拉链连帽衫，生态棉抓绒全拉链男款连帽卫衣
  1307 + - #4 [L0] spu=69424 Hanes mens Zip-up Hoodie, Ecosmart Fleece Full-zip Hoodie for Men, Hooded Sweatshirt (rel=161.67407)
  1308 + zh: Hanes 男士拉链连帽衫，生态棉抓绒全拉链男款连帽卫衣
  1309 + - #5 [L0] spu=63350 Century Star Womens Fuzzy Hoodies Pullover Sport Hoodie Cozy Oversized Pockets Hooded Sweatshirt Athletic Fleece Hoodies (rel=159.755)
  1310 + zh: 世纪之星女士加绒连帽运动卫衣 保暖宽松口袋套头毛绒卫衣 运动抓绒连帽衫
  1311 +
  1312 +### sock boots
  1313 +
  1314 +- Primary_Metric_Score: 0.333972
  1315 +- NDCG@20: 0.330658
  1316 +- NDCG@50: 0.389531
  1317 +- ERR@10: 0.929688
  1318 +- Strong_Precision@10: 0.2
  1319 +- Strong_Precision@20: 0.1
  1320 +- Useful_Precision@50: 0.5
  1321 +- Avg_Grade@10: 0.6
  1322 +- Gain_Recall@20: 0.021898
  1323 +- ERR@10: 0.929688
  1324 +- ERR@20: 0.93003
  1325 +- ERR@5: 0.929688
  1326 +- ERR@50: 0.930494
  1327 +- Exact_Precision@10: 0.2
  1328 +- Exact_Precision@20: 0.1
  1329 +- Exact_Precision@5: 0.4
  1330 +- Exact_Success@10: 1.0
  1331 +- Exact_Success@5: 1.0
  1332 +- Gain_Recall@10: 0.014599
  1333 +- Gain_Recall@50: 0.087591
  1334 +- MRR_Exact@10: 1.0
  1335 +- MRR_Strong@10: 1.0
  1336 +- NDCG@10: 0.406527
  1337 +- NDCG@5: 0.553146
  1338 +- Strong_Precision@5: 0.4
  1339 +- Strong_Success@10: 1.0
  1340 +- Strong_Success@5: 1.0
  1341 +- Useful_Precision@10: 0.2
  1342 +- Useful_Precision@20: 0.25
  1343 +- Fully Relevant: 4
  1344 +- Mostly Relevant: 8
  1345 +- Weakly Relevant: 33
  1346 +- Irrelevant: 55
  1347 +- Request ID: `377dff9d`
  1348 +- Top-10 Labels: `1:L3 | 2:L3 | 3:L0 | 4:L0 | 5:L0 | 6:L0 | 7:L0 | 8:L0 | 9:L0 | 10:L0`
  1349 +- Top-20 Labels: `1:L3 | 2:L3 | 3:L0 | 4:L0 | 5:L0 | 6:L0 | 7:L0 | 8:L0 | 9:L0 | 10:L0 | 11:L1 | 12:L0 | 13:L0 | 14:L0 | 15:L0 | 16:L0 | 17:L0 | 18:L0 | 19:L1 | 20:L1`
  1350 +- Case Snapshot:
  1351 + - #1 [L3] spu=61848 AMINUGAL Womens Elastic Knee High Platform Chunky Block High Heel Sock Boots Zipper Round Toe Fashion Motorcycle Combat Punk Boots For Women (rel=215.10117)
  1352 + zh: AMINUGAL 女士弹力高筒平台粗跟方头拉链时尚机车朋克风短靴
  1353 + - #2 [L3] spu=67747 Women’s Knee High Boots Round Toe Stretch Platform Chunky High Heel Elastic Sock Boot with Side Zipper Fashion Comfortable Dress Shoes (rel=305.82635)
  1354 + zh: 女式及膝短靴 圆头 弹性鞋身 厚底高跟 侧边拉链 时尚舒适连袜靴
  1355 + - #3 [L0] spu=63534 Alvada Warm Thermal Wool Socks for Winter Moisture Wicking and Breathable Cozy Boot Socks (rel=170.66544)
  1356 + zh: Alvada 保暖加厚羊毛袜 冬季吸湿排汗 透气舒适靴袜
  1357 + - #4 [L0] spu=66199 Alvada Warm Thermal Wool Socks for Winter Moisture Wicking and Breathable Cozy Boot Socks (rel=170.66544)
  1358 + zh: Alvada 保暖加厚羊毛袜 冬季吸湿排汗 透气舒适靴袜
  1359 + - #5 [L0] spu=66633 Hand-Knitted 100% Wool Socks, Beige White Cozy Winter Socks, Rustic Boot Socks with Gray, Blue Yellow Pattern, Warm Gift for Him & Her (Men's 8-8.5) (rel=163.5785)
  1360 + zh: 手工编织100%纯羊毛袜，米白保暖冬季袜，复古风格靴袜，灰色蓝黄图案，男女通用温暖礼物（男码8-8.5）
  1361 +
  1362 +### 旅行服装
  1363 +
  1364 +- Primary_Metric_Score: 0.797688
  1365 +- NDCG@20: 0.928041
  1366 +- NDCG@50: 0.787677
  1367 +- ERR@10: 0.93472
  1368 +- Strong_Precision@10: 1.0
  1369 +- Strong_Precision@20: 0.9
  1370 +- Useful_Precision@50: 0.82
  1371 +- Avg_Grade@10: 3.0
  1372 +- Gain_Recall@20: 0.011068
  1373 +- ERR@10: 0.93472
  1374 +- ERR@20: 0.93472
  1375 +- ERR@5: 0.934715
  1376 +- ERR@50: 0.93472
  1377 +- Exact_Precision@10: 1.0
  1378 +- Exact_Precision@20: 0.9
  1379 +- Exact_Precision@5: 1.0
  1380 +- Exact_Success@10: 1.0
  1381 +- Exact_Success@5: 1.0
  1382 +- Gain_Recall@10: 0.006149
  1383 +- Gain_Recall@50: 0.022341
  1384 +- MRR_Exact@10: 1.0
  1385 +- MRR_Strong@10: 1.0
  1386 +- NDCG@10: 1.0
  1387 +- NDCG@5: 1.0
  1388 +- Strong_Precision@5: 1.0
  1389 +- Strong_Success@10: 1.0
  1390 +- Strong_Success@5: 1.0
  1391 +- Useful_Precision@10: 1.0
  1392 +- Useful_Precision@20: 0.9
  1393 +- Fully Relevant: 50
  1394 +- Mostly Relevant: 8
  1395 +- Weakly Relevant: 13
  1396 +- Irrelevant: 29
  1397 +- Request ID: `9e1d4025`
  1398 +- Top-10 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L3 | 6:L3 | 7:L3 | 8:L3 | 9:L3 | 10:L3`
  1399 +- Top-20 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L3 | 6:L3 | 7:L3 | 8:L3 | 9:L3 | 10:L3 | 11:L0 | 12:L3 | 13:L3 | 14:L3 | 15:L3 | 16:L3 | 17:L3 | 18:L3 | 19:L3 | 20:L0`
  1400 +- Case Snapshot:
  1401 + - #1 [L3] spu=63905 PRETTYGARDEN Women's Fall 2 Piece Lounge Set Long Sleeve Tops Ribbed Pants Spring Matching Sweatsuit Travel Outfits Clothes (rel=244.68576)
  1402 + zh: PRETTYGARDEN 女士秋季两件套休闲服 长袖上衣罗纹裤 春季配套运动套装 旅行服装
  1403 + - #2 [L3] spu=69403 Women Adventure Awaits Outdoor Graphic Tee Shirt Kindness Heart Printed Hike Mountain Nature Travel Shirt Workout Tops (rel=90.26596)
  1404 + zh: 女性户外探险主题印花T恤 心形善意设计 登山自然旅行运动上衣
  1405 + - #3 [L3] spu=67589 Women Adventure Awaits Outdoor Graphic Tee Shirt Kindness Heart Printed Hike Mountain Nature Travel Shirt Workout Tops (rel=90.26596)
  1406 + zh: 女性户外探险主题印花T恤 心形善意设计 登山自然旅行运动上衣
  1407 + - #4 [L3] spu=65578 PRETTYGARDEN Women's Fall 2 Piece Lounge Sets Zip Up Sweatshirt Jogger Pants Sweat Track Suits Travel Outfit Winter Clothing (rel=134.89957)
  1408 + zh: PRETTYGARDEN 女士秋季两件套休闲套装 拉链上衣运动裤卫衣套装 旅行服 冬季服装
  1409 + - #5 [L3] spu=67114 Swimsuit Coverup Summer Dresses for Women Vacation Essentials Eyelet Crew Neck Loose Sleeveless Twisted Dresses (rel=55.600277)
  1410 + zh: 女士泳衣罩衫 夏季连衣裙 旅行必备 眼孔设计 圆领 宽松无袖 缠绕式连衣裙
  1411 +
  1412 +### khaki green backpack
  1413 +
  1414 +- Primary_Metric_Score: 0.30191
  1415 +- NDCG@20: 0.623004
  1416 +- NDCG@50: 0.623004
  1417 +- ERR@10: 0.272014
  1418 +- Strong_Precision@10: 0.0
  1419 +- Strong_Precision@20: 0.0
  1420 +- Useful_Precision@50: 0.16
  1421 +- Avg_Grade@10: 0.8
  1422 +- Gain_Recall@20: 0.470588
  1423 +- ERR@10: 0.272014
  1424 +- ERR@20: 0.272014
  1425 +- ERR@5: 0.247178
  1426 +- ERR@50: 0.272014
  1427 +- Exact_Precision@10: 0.0
  1428 +- Exact_Precision@20: 0.0
  1429 +- Exact_Precision@5: 0.0
  1430 +- Exact_Success@10: 0.0
  1431 +- Exact_Success@5: 0.0
  1432 +- Gain_Recall@10: 0.470588
  1433 +- Gain_Recall@50: 0.470588
  1434 +- MRR_Exact@10: 0.0
  1435 +- MRR_Strong@10: 0.0
  1436 +- NDCG@10: 0.870125
  1437 +- NDCG@5: 1.0
  1438 +- Strong_Precision@5: 0.0
  1439 +- Strong_Success@10: 0.0
  1440 +- Strong_Success@5: 0.0
  1441 +- Useful_Precision@10: 0.8
  1442 +- Useful_Precision@20: 0.4
  1443 +- Fully Relevant: 0
  1444 +- Mostly Relevant: 0
  1445 +- Weakly Relevant: 9
  1446 +- Irrelevant: 91
  1447 +- Request ID: `7d672957`
  1448 +- Top-10 Labels: `1:L1 | 2:L1 | 3:L1 | 4:L1 | 5:L1 | 6:L1 | 7:L1 | 8:L1 | 9:L0 | 10:L0`
  1449 +- Top-20 Labels: `1:L1 | 2:L1 | 3:L1 | 4:L1 | 5:L1 | 6:L1 | 7:L1 | 8:L1 | 9:L0 | 10:L0 | 11:L0 | 12:L0 | 13:L0 | 14:L0 | 15:L0 | 16:L0 | 17:L0 | 18:L0 | 19:L0 | 20:L0`
  1450 +- Case Snapshot:
  1451 + - #1 [L1] spu=61261 Quikflip 2-in-1 Reversible Backpack Hoodie (As Seen on SHARK TANK) Unisex Full-Zip Hero Hoodie (rel=166.0851)
  1452 + zh: Quikflip 2合1可翻转背包连帽衫（鲨鱼坦克同款）男女通用拉链连帽衫
  1453 + - #2 [L1] spu=64361 Wildhorn Brimhall Ski Boot Bag and Snowboard Backpack -US Ski Team Official Supplier- Premium Durable Waterproof Travel Ski boot bag backpack for Boots, Helmets, Goggles & Outerwear (rel=150.8)
  1454 + zh: Wildhorn Brimhall 雪上运动鞋包及单板背包——美国滑雪队官方供应商——高品质耐用防水旅行滑雪鞋包，可装雪靴、头盔、护目镜及外衣
  1455 + - #3 [L1] spu=62920 LOVEVOOK 40L Travel Backpack for Men, Airline Approved Carry On Luggage with 3 Packing Cubes, TSA Overnight Bags, Waterproof Personal Item Bag, Weekender Essentials Backpacks fits 17.3" Laptop (rel=167.0116)
  1456 + zh: LOVEVOOK 40升男士旅行背包，符合航空公司随身行李标准，含3个收纳袋，TSA认证过夜行李包，防水个人物品袋，周末出行必备背包，可容纳17.3英寸笔记本电脑
  1457 + - #4 [L1] spu=64682 YAMTION 18.4in Men Laptop Backpack with Shoe Compartment for Gym Hiking Business,Large Carry On Travel Bag with PC Compartment,Waterproof College Bookbag School Backpack for Women,Black (rel=165.5384)
  1458 + zh: YAMTION 18.4英寸男款带鞋袋运动登山商务大容量登机旅行背包，带PC电脑隔层防水学生书包女款，黑色
  1459 + - #5 [L1] spu=67688 BULLCAPTAIN Men's Leather Samll Crossbody Backpack Sling Chest Bag for Hiking Travel (rel=161.77977)
  1460 + zh: BULLCAPTAIN 男款真皮小号斜挎背包 旅行登山胸包
  1461 +
  1462 +### 皱边裙
  1463 +
  1464 +- Primary_Metric_Score: 0.67685
  1465 +- NDCG@20: 0.764247
  1466 +- NDCG@50: 0.654801
  1467 +- ERR@10: 0.917385
  1468 +- Strong_Precision@10: 0.7
  1469 +- Strong_Precision@20: 0.8
  1470 +- Useful_Precision@50: 0.88
  1471 +- Avg_Grade@10: 2.0
  1472 +- Gain_Recall@20: 0.031702
  1473 +- ERR@10: 0.917385
  1474 +- ERR@20: 0.917386
  1475 +- ERR@5: 0.916636
  1476 +- ERR@50: 0.917386
  1477 +- Exact_Precision@10: 0.5
  1478 +- Exact_Precision@20: 0.65
  1479 +- Exact_Precision@5: 0.4
  1480 +- Exact_Success@10: 1.0
  1481 +- Exact_Success@5: 1.0
  1482 +- Gain_Recall@10: 0.013784
  1483 +- Gain_Recall@50: 0.064094
  1484 +- MRR_Exact@10: 1.0
  1485 +- MRR_Strong@10: 1.0
  1486 +- NDCG@10: 0.705429
  1487 +- NDCG@5: 0.764918
  1488 +- Strong_Precision@5: 0.8
  1489 +- Strong_Success@10: 1.0
  1490 +- Strong_Success@5: 1.0
  1491 +- Useful_Precision@10: 0.8
  1492 +- Useful_Precision@20: 0.85
  1493 +- Fully Relevant: 25
  1494 +- Mostly Relevant: 26
  1495 +- Weakly Relevant: 42
  1496 +- Irrelevant: 7
  1497 +- Request ID: `7431b8cd`
  1498 +- Top-10 Labels: `1:L3 | 2:L1 | 3:L3 | 4:L2 | 5:L2 | 6:L0 | 7:L3 | 8:L3 | 9:L3 | 10:L0`
  1499 +- Top-20 Labels: `1:L3 | 2:L1 | 3:L3 | 4:L2 | 5:L2 | 6:L0 | 7:L3 | 8:L3 | 9:L3 | 10:L0 | 11:L3 | 12:L3 | 13:L3 | 14:L3 | 15:L3 | 16:L2 | 17:L0 | 18:L3 | 19:L3 | 20:L3`
  1500 +- Case Snapshot:
  1501 + - #1 [L3] spu=68377 Korean Style Elastic Waist Fashionable Versatile Mesh Splicing Mid-Length High-Waisted Skirt S-5Xl Multi-Size Ruffle Skirt (rel=186.69409)
  1502 + zh: 韩版高腰弹力网眼拼接中长款百搭A字裙 S-5XL 多码褶边裙
  1503 + - #2 [L1] spu=68297 2025 Summer New White Ruffle Skirt for Tall Women, Lightweight A-Line Lantern Skirt (rel=210.9303)
  1504 + zh: 今年流行2025夏季新款白色花苞半身裙女高个子薄款灯笼裙高a字裙
  1505 + - #3 [L3] spu=61058 Verdusa Women's Western Boho Lace Ruffle Skirt Asymmetrical Country Cowgirl Skirts (rel=202.97264)
  1506 + zh: Verdusa 女士西部波西米亚蕾丝荷叶边不规则乡村牛仔裙
  1507 + - #4 [L2] spu=68389 Pirates of the Caribbean Style Ruffle Midi Skirt, Simple & Versatile Dance Skirt for Export, Factory Wholesale (rel=124.988205)
  1508 + zh: 加勒比海盗角色褶皱半身裙 欧美简约百搭舞蹈裙外贸货源 工厂批发
  1509 + - #5 [L2] spu=68622 Lace-Panelled Women's Summer 2026 New High-Waisted Slimming Sweet Youthful A-Line Short Cake Skirt (rel=158.93762)
  1510 + zh: 蕾丝拼接半身裙女夏季2026新款高腰显瘦甜美减龄A字蓬蓬蛋糕短裙
  1511 +
  1512 +### 高跟鞋
  1513 +
  1514 +- Primary_Metric_Score: 0.808957
  1515 +- NDCG@20: 0.895255
  1516 +- NDCG@50: 0.931694
  1517 +- ERR@10: 0.918038
  1518 +- Strong_Precision@10: 0.9
  1519 +- Strong_Precision@20: 0.85
  1520 +- Useful_Precision@50: 1.0
  1521 +- Avg_Grade@10: 2.8
  1522 +- Gain_Recall@20: 0.043339
  1523 +- ERR@10: 0.918038
  1524 +- ERR@20: 0.918038
  1525 +- ERR@5: 0.918003
  1526 +- ERR@50: 0.918038
  1527 +- Exact_Precision@10: 0.9
  1528 +- Exact_Precision@20: 0.85
  1529 +- Exact_Precision@5: 0.8
  1530 +- Exact_Success@10: 1.0
  1531 +- Exact_Success@5: 1.0
  1532 +- Gain_Recall@10: 0.022472
  1533 +- Gain_Recall@50: 0.113965
  1534 +- MRR_Exact@10: 1.0
  1535 +- MRR_Strong@10: 1.0
  1536 +- NDCG@10: 0.907425
  1537 +- NDCG@5: 0.857342
  1538 +- Strong_Precision@5: 0.8
  1539 +- Strong_Success@10: 1.0
  1540 +- Strong_Success@5: 1.0
  1541 +- Useful_Precision@10: 1.0
  1542 +- Useful_Precision@20: 1.0
  1543 +- Fully Relevant: 93
  1544 +- Mostly Relevant: 2
  1545 +- Weakly Relevant: 5
  1546 +- Irrelevant: 0
  1547 +- Request ID: `75fde77e`
  1548 +- Top-10 Labels: `1:L3 | 2:L1 | 3:L3 | 4:L3 | 5:L3 | 6:L3 | 7:L3 | 8:L3 | 9:L3 | 10:L3`
  1549 +- Top-20 Labels: `1:L3 | 2:L1 | 3:L3 | 4:L3 | 5:L3 | 6:L3 | 7:L3 | 8:L3 | 9:L3 | 10:L3 | 11:L3 | 12:L3 | 13:L3 | 14:L3 | 15:L3 | 16:L3 | 17:L1 | 18:L1 | 19:L3 | 20:L3`
  1550 +- Case Snapshot:
  1551 + - #1 [L3] spu=64927 Trary Mary Jane Shoes Women Heels Platform Chunky Block High Heels with Double Strap Women's Pumps Comfortable Dress Pumps for Party Wedding Office Round Toe Heel Shoes (rel=264.51318)
  1552 + zh: 玛丽珍女士高跟鞋 厚底方跟双带设计 通勤婚宴派对舒适高跟鞋 圆头
  1553 + - #2 [L1] spu=62529 WUXIN H&P Women's 7 Inch Clear Platform Heels - Ankle-Strap Sexy Pole Dance High Heel, Exotic Dancer Shoes Stiletto 17CM (rel=257.21094)
  1554 + zh: WUXIN H&P 女士7英寸透明高跟鞋 - 脚踝带性感钢管舞高跟鞋，异域舞者专用细跟17厘米
  1555 + - #3 [L3] spu=67097 JOY IN LOVE Women's Pumps Shoes 3.5" High Heels Pointy Toe Stiletto Pumps (rel=285.73434)
  1556 + zh: JOY IN LOVE 女士高跟鞋 3.5英寸尖头细跟高跟鞋
  1557 + - #4 [L3] spu=60558 JOY IN LOVE Women's Pumps Shoes 3.5" High Heels Pointy Toe Stiletto Pumps (rel=284.97983)
  1558 + zh: JOY IN LOVE 女士高跟鞋 3.5英寸尖头细跟高跟鞋
  1559 + - #5 [L3] spu=61866 Womens Closed Toe Ankle Strap Heels Pointed Toe Pumps Shoes Slingback High Heel Wedding Dress Shoes (rel=279.92014)
  1560 + zh: 女式封闭式脚趾踝带尖头高跟鞋 婚纱鞋 搭扣高跟鞋
  1561 +
  1562 +### 图案连身衣
  1563 +
  1564 +- Primary_Metric_Score: 0.284152
  1565 +- NDCG@20: 0.321979
  1566 +- NDCG@50: 0.385425
  1567 +- ERR@10: 0.280544
  1568 +- Strong_Precision@10: 0.0
  1569 +- Strong_Precision@20: 0.0
  1570 +- Useful_Precision@50: 0.92
  1571 +- Avg_Grade@10: 1.0
  1572 +- Gain_Recall@20: 0.031933
  1573 +- ERR@10: 0.280544
  1574 +- ERR@20: 0.293846
  1575 +- ERR@5: 0.247178
  1576 +- ERR@50: 0.296878
  1577 +- Exact_Precision@10: 0.0
  1578 +- Exact_Precision@20: 0.0
  1579 +- Exact_Precision@5: 0.0
  1580 +- Exact_Success@10: 0.0
  1581 +- Exact_Success@5: 0.0
  1582 +- Gain_Recall@10: 0.016807
  1583 +- Gain_Recall@50: 0.084034
  1584 +- MRR_Exact@10: 0.0
  1585 +- MRR_Strong@10: 0.0
  1586 +- NDCG@10: 0.333333
  1587 +- NDCG@5: 0.333333
  1588 +- Strong_Precision@5: 0.0
  1589 +- Strong_Success@10: 0.0
  1590 +- Strong_Success@5: 0.0
  1591 +- Useful_Precision@10: 1.0
  1592 +- Useful_Precision@20: 0.95
  1593 +- Fully Relevant: 9
  1594 +- Mostly Relevant: 5
  1595 +- Weakly Relevant: 62
  1596 +- Irrelevant: 24
  1597 +- Request ID: `bd20e53d`
  1598 +- Top-10 Labels: `1:L1 | 2:L1 | 3:L1 | 4:L1 | 5:L1 | 6:L1 | 7:L1 | 8:L1 | 9:L1 | 10:L1`
  1599 +- Top-20 Labels: `1:L1 | 2:L1 | 3:L1 | 4:L1 | 5:L1 | 6:L1 | 7:L1 | 8:L1 | 9:L1 | 10:L1 | 11:L1 | 12:L1 | 13:L1 | 14:L1 | 15:L1 | 16:L1 | 17:L0 | 18:L1 | 19:L1 | 20:L1`
  1600 +- Case Snapshot:
  1601 + - #1 [L1] spu=65269 MANER Women’s Sequin Romper Sparkly Short Jumpsuit Party Concert Outfit With Flutter Sleeve (rel=146.91672)
  1602 + zh: MANER 女士亮片连体裤 闪亮短款连身衣 派对演唱会服装 蝴蝶袖
  1603 + - #2 [L1] spu=62222 QINSEN Jumpsuits for Women Square Neck Wide Leg Full Length Romper Playsuit (rel=151.29184)
  1604 + zh: 秦森女士方领阔腿连体裤长款连身衣
  1605 + - #3 [L1] spu=61827 OQQ Women Long Sleeve Yoga Jumpsuits Workout Ribbed Bodysuits Pants Sexy One Piece (rel=144.08981)
  1606 + zh: OQQ 女士长袖瑜伽连体衣 运动针织连身裤 修身一体式性感泳装
  1607 + - #4 [L1] spu=65449 Maternity Workout Romper Pregnancy Yoga Ribbed One Piece Seamless Tank Top Jumpsuit (rel=160.36513)
  1608 + zh: 孕妇健身连体衣 产后瑜伽收腹连体衣 弹力一体式无缝背心连身裤
  1609 + - #5 [L1] spu=64702 POSHDIVAH Women's Maternity Bodysuit Pregnancy Shapewear Double Lined Sleeveless Tank Top Shorts Romper Jumpsuit (rel=158.29726)
  1610 + zh: POSHDIVAH 女士孕妇连体衣 两层加厚无袖背心短裤连身衣 连体裤
  1611 +
  1612 +### 天鹅绒鸡尾酒会礼服
  1613 +
  1614 +- Primary_Metric_Score: 0.654332
  1615 +- NDCG@20: 0.75112
  1616 +- NDCG@50: 0.715491
  1617 +- ERR@10: 0.934708
  1618 +- Strong_Precision@10: 0.6
  1619 +- Strong_Precision@20: 0.45
  1620 +- Useful_Precision@50: 1.0
  1621 +- Avg_Grade@10: 2.2
  1622 +- Gain_Recall@20: 0.05
  1623 +- ERR@10: 0.934708
  1624 +- ERR@20: 0.934708
  1625 +- ERR@5: 0.934678
  1626 +- ERR@50: 0.934708
  1627 +- Exact_Precision@10: 0.6
  1628 +- Exact_Precision@20: 0.4
  1629 +- Exact_Precision@5: 0.8
  1630 +- Exact_Success@10: 1.0
  1631 +- Exact_Success@5: 1.0
  1632 +- Gain_Recall@10: 0.02973
  1633 +- Gain_Recall@50: 0.102703
  1634 +- MRR_Exact@10: 1.0
  1635 +- MRR_Strong@10: 1.0
  1636 +- NDCG@10: 0.800515
  1637 +- NDCG@5: 0.91253
  1638 +- Strong_Precision@5: 0.8
  1639 +- Strong_Success@10: 1.0
  1640 +- Strong_Success@5: 1.0
  1641 +- Useful_Precision@10: 1.0
  1642 +- Useful_Precision@20: 1.0
  1643 +- Fully Relevant: 13
  1644 +- Mostly Relevant: 3
  1645 +- Weakly Relevant: 81
  1646 +- Irrelevant: 3
  1647 +- Request ID: `de1481e5`
  1648 +- Top-10 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L1 | 6:L1 | 7:L3 | 8:L1 | 9:L1 | 10:L3`
  1649 +- Top-20 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L1 | 6:L1 | 7:L3 | 8:L1 | 9:L1 | 10:L3 | 11:L1 | 12:L1 | 13:L1 | 14:L1 | 15:L3 | 16:L1 | 17:L1 | 18:L1 | 19:L3 | 20:L2`
  1650 +- Case Snapshot:
  1651 + - #1 [L3] spu=65258 IHOT 2025 Women's Sexy V Neck Long Sheer Sleeve Velvet Faux Wrap Ruched Sheath Bodycon Cocktail Party Dress (rel=384.5398)
  1652 + zh: IHOT 2025 女士性感V领长透视袖丝绒仿裹身褶皱紧身鸡尾酒会礼服
  1653 + - #2 [L3] spu=60683 MEROKEETY Women's V Neck Wrap Velvet Maxi Wedding Guest Dress Bell Sleeve Split Bridesmaid Cocktail Party Formal Dresses (rel=289.65005)
  1654 + zh: MEROKEETY 女士V领缠绕丝绒长款婚纱宾客礼服 泡泡袖开衩伴娘鸡尾酒会正式礼服
  1655 + - #3 [L3] spu=64555 Bbonlinedress Womens Velvet Long Sleeve Formal Wedding Guest Vintage Cocktail Holiday Party Midi Dress (rel=158.97514)
  1656 + zh: Bbonline 女士丝绒长袖正式婚礼宾客复古鸡尾酒假日派对中长款连衣裙
  1657 + - #4 [L3] spu=61819 CYiNu Women's V Neck Wrap Velvet Long Sleeve Elegant Bodycon Ruched Cocktail Party Maxi Dress (rel=209.27107)
  1658 + zh: CYiNu 女士V领缠绕丝绒长袖优雅包身收褶鸡尾酒会连衣裙
  1659 + - #5 [L1] spu=64171 DeftSharp Womens Ruched Formal Bodycon Zipper Graduation Dresses-Elegant Cocktail Party Wedding Midi Dress (rel=215.85287)
  1660 + zh: DeftSharp 女士褶皱正式修身拉链毕业礼服——优雅鸡尾酒会婚礼及中长款连衣裙
  1661 +
  1662 +### gingham dress
  1663 +
  1664 +- Primary_Metric_Score: 0.288345
  1665 +- NDCG@20: 0.381764
  1666 +- NDCG@50: 0.275763
  1667 +- ERR@10: 0.889079
  1668 +- Strong_Precision@10: 0.1
  1669 +- Strong_Precision@20: 0.1
  1670 +- Useful_Precision@50: 0.34
  1671 +- Avg_Grade@10: 0.6
  1672 +- Gain_Recall@20: 0.020155
  1673 +- ERR@10: 0.889079
  1674 +- ERR@20: 0.892833
  1675 +- ERR@5: 0.88737
  1676 +- ERR@50: 0.893411
  1677 +- Exact_Precision@10: 0.1
  1678 +- Exact_Precision@20: 0.05
  1679 +- Exact_Precision@5: 0.2
  1680 +- Exact_Success@10: 1.0
  1681 +- Exact_Success@5: 1.0
  1682 +- Gain_Recall@10: 0.009302
  1683 +- Gain_Recall@50: 0.031008
  1684 +- MRR_Exact@10: 1.0
  1685 +- MRR_Strong@10: 1.0
  1686 +- NDCG@10: 0.397954
  1687 +- NDCG@5: 0.514575
  1688 +- Strong_Precision@5: 0.2
  1689 +- Strong_Success@10: 1.0
  1690 +- Strong_Success@5: 1.0
  1691 +- Useful_Precision@10: 0.4
  1692 +- Useful_Precision@20: 0.5
  1693 +- Fully Relevant: 1
  1694 +- Mostly Relevant: 3
  1695 +- Weakly Relevant: 30
  1696 +- Irrelevant: 66
  1697 +- Request ID: `c416c206`
  1698 +- Top-10 Labels: `1:L3 | 2:L1 | 3:L1 | 4:L0 | 5:L0 | 6:L0 | 7:L1 | 8:L0 | 9:L0 | 10:L0`
  1699 +- Top-20 Labels: `1:L3 | 2:L1 | 3:L1 | 4:L0 | 5:L0 | 6:L0 | 7:L1 | 8:L0 | 9:L0 | 10:L0 | 11:L0 | 12:L0 | 13:L1 | 14:L1 | 15:L1 | 16:L2 | 17:L0 | 18:L1 | 19:L1 | 20:L0`
  1700 +- Case Snapshot:
  1701 + - #1 [L3] spu=63960 Allegra K Women Gingham Dress Summer Short Sleeve Crew Neck Lace Panel Plaid Mini Dresses Halloween Dorothy Costume (rel=238.41098)
  1702 + zh: Allegra K 女士夏装格子连衣裙 短袖圆领蕾丝拼接方格迷你裙 万圣节多萝西造型服饰
  1703 + - #2 [L1] spu=65440 Noubeau Toddler Baby Girls Plaid Outfits Knit Ribbed Sweatshirt Shirt Tops Red Plaid Belt Skirt Fall Winter Clothes (rel=124.01087)
  1704 + zh: Noubeau 婴幼儿女童格子套装配针织罗纹卫衣上衣 红色格子腰带裙 秋冬服装
  1705 + - #3 [L1] spu=66016 Halloween Costumes for Women Blue Gingham Book Storybook Character Outfits (rel=93.33869)
  1706 + zh: 女士万圣节服装 蓝色格子书本故事角色装扮
  1707 + - #4 [L0] spu=64966 Alimens & Gentle Men's Plaid Button Down Shirts Cotton Long Sleeve Dress Shirts Regular Fit Gingham Shirts (rel=105.19191)
  1708 + zh: 艾利门斯与绅士纯棉格纹长袖衬衫 男式正装休闲款 格子衬衫
  1709 + - #5 [L0] spu=68937 Summer New European and American Spice Girls Cross-border Suspenders V-neck Satin Split Sexy Backless Long Dress Dress dress (rel=41.840504)
  1710 + zh: 夏季新款欧美风辣妹跨海吊带背心缎面分体性感露背长裙
  1711 +
  1712 +### 海滩度假装
  1713 +
  1714 +- Primary_Metric_Score: 0.846033
  1715 +- NDCG@20: 0.951547
  1716 +- NDCG@50: 0.938392
  1717 +- ERR@10: 0.93472
  1718 +- Strong_Precision@10: 1.0
  1719 +- Strong_Precision@20: 0.95
  1720 +- Useful_Precision@50: 0.98
  1721 +- Avg_Grade@10: 3.0
  1722 +- Gain_Recall@20: 0.013605
  1723 +- ERR@10: 0.93472
  1724 +- ERR@20: 0.93472
  1725 +- ERR@5: 0.934715
  1726 +- ERR@50: 0.93472
  1727 +- Exact_Precision@10: 1.0
  1728 +- Exact_Precision@20: 0.9
  1729 +- Exact_Precision@5: 1.0
  1730 +- Exact_Success@10: 1.0
  1731 +- Exact_Success@5: 1.0
  1732 +- Gain_Recall@10: 0.007289
  1733 +- Gain_Recall@50: 0.033771
  1734 +- MRR_Exact@10: 1.0
  1735 +- MRR_Strong@10: 1.0
  1736 +- NDCG@10: 1.0
  1737 +- NDCG@5: 1.0
  1738 +- Strong_Precision@5: 1.0
  1739 +- Strong_Success@10: 1.0
  1740 +- Strong_Success@5: 1.0
  1741 +- Useful_Precision@10: 1.0
  1742 +- Useful_Precision@20: 0.95
  1743 +- Fully Relevant: 86
  1744 +- Mostly Relevant: 5
  1745 +- Weakly Relevant: 8
  1746 +- Irrelevant: 1
  1747 +- Request ID: `383ed33c`
  1748 +- Top-10 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L3 | 6:L3 | 7:L3 | 8:L3 | 9:L3 | 10:L3`
  1749 +- Top-20 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L3 | 6:L3 | 7:L3 | 8:L3 | 9:L3 | 10:L3 | 11:L3 | 12:L3 | 13:L0 | 14:L3 | 15:L3 | 16:L3 | 17:L3 | 18:L2 | 19:L3 | 20:L3`
  1750 +- Case Snapshot:
  1751 + - #1 [L3] spu=60625 Eomenie Women's Contrast Lace Bathing Suit Cover Up V-Neck Swimsuit Coverups Loose Swimwear Beach Dress Beachwear (rel=206.29437)
  1752 + zh: Eomenie 女士拼接蕾丝泳衣罩衫 V领泳装外套 宽松泳衣 海滩连衣裙 时尚泳装
  1753 + - #2 [L3] spu=67706 ANRABESS Women Beach Crochet Cover Ups Summer Knit Swimwear Mesh Bathing Suit Hollow Out Dress 2025 Vacation Swimsuit (rel=123.39278)
  1754 + zh: ANRABESS 女士夏季钩针编织罩衫 海滩泳衣网眼露肤连衣裙 2025度假泳装
  1755 + - #3 [L3] spu=62886 Bsubseach Women Swimsuit Coverup Shirt Dress Button Down Bathing Suit Cover Up Beachwear (rel=161.15042)
  1756 + zh: Bsubseach 女士泳衣罩衫衬衫式连体泳装 一字扣防晒沙滩装
  1757 + - #4 [L3] spu=61244 ZAFUL Women's Triangle Bikini Floral String Bikini Set Two Piece Swimsuit Bathing Suits (rel=117.47891)
  1758 + zh: ZAFUL女式三角款花边绑带比基尼套装两件式泳装
  1759 + - #5 [L3] spu=67822 Amazon Export Supply European and American Long-Sleeved Pure Color Beach Vacation Sun Protection Clothing Two-Piece Set Blouse 17 Colors in Stock (rel=82.79002)
  1760 + zh: 亚马逊出口供应 欧美风长袖纯色沙滩度假防晒服 两件套 上衣 17种颜色 现货
  1761 +
  1762 +### vacation outfits
  1763 +
  1764 +- Primary_Metric_Score: 0.829886
  1765 +- NDCG@20: 0.949769
  1766 +- NDCG@50: 0.878411
  1767 +- ERR@10: 0.93472
  1768 +- Strong_Precision@10: 1.0
  1769 +- Strong_Precision@20: 0.95
  1770 +- Useful_Precision@50: 0.98
  1771 +- Avg_Grade@10: 2.8
  1772 +- Gain_Recall@20: 0.012853
  1773 +- ERR@10: 0.93472
  1774 +- ERR@20: 0.93472
  1775 +- ERR@5: 0.934715
  1776 +- ERR@50: 0.93472
  1777 +- Exact_Precision@10: 0.8
  1778 +- Exact_Precision@20: 0.85
  1779 +- Exact_Precision@5: 1.0
  1780 +- Exact_Success@10: 1.0
  1781 +- Exact_Success@5: 1.0
  1782 +- Gain_Recall@10: 0.006426
  1783 +- Gain_Recall@50: 0.029378
  1784 +- MRR_Exact@10: 1.0
  1785 +- MRR_Strong@10: 1.0
  1786 +- NDCG@10: 0.956708
  1787 +- NDCG@5: 1.0
  1788 +- Strong_Precision@5: 1.0
  1789 +- Strong_Success@10: 1.0
  1790 +- Strong_Success@5: 1.0
  1791 +- Useful_Precision@10: 1.0
  1792 +- Useful_Precision@20: 1.0
  1793 +- Fully Relevant: 57
  1794 +- Mostly Relevant: 4
  1795 +- Weakly Relevant: 18
  1796 +- Irrelevant: 21
  1797 +- Request ID: `21947130`
  1798 +- Top-10 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L3 | 6:L3 | 7:L3 | 8:L3 | 9:L2 | 10:L2`
  1799 +- Top-20 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L3 | 6:L3 | 7:L3 | 8:L3 | 9:L2 | 10:L2 | 11:L3 | 12:L3 | 13:L3 | 14:L3 | 15:L3 | 16:L3 | 17:L3 | 18:L1 | 19:L3 | 20:L3`
  1800 +- Case Snapshot:
  1801 + - #1 [L3] spu=62331 QegarTop Kimono Shorts Set for Women Two Piece Summer Vacation Outfits Flowy Beach Cover up Duster (rel=234.59885)
  1802 + zh: QegarTop 女士开衫短裤套装 两件套 夏季度假穿搭 流动感沙滩外罩 飘逸斗篷
  1803 + - #2 [L3] spu=62048 ANRABESS Jumpsuits for Women Casual Summer Overalls Sleeveless Spaghetti Strap Romper Jumpers Trendy Beach Vacation Outfits (rel=239.77002)
  1804 + zh: ANRABESS 女士夏季休闲连体裤 无袖细带沙滩度假装 时尚连身裙
  1805 + - #3 [L3] spu=62806 UNIANKIYA One Piece Jumpsuits for Women Casual Overalls Sleeveless Strap Rompers Travel Vacation Outfits Fall Fashion Clothes (rel=233.14854)
  1806 + zh: UNIANKIYA 女士连体裤 休闲背心式连体衣 无袖吊带裤 旅行度假服 秋季时尚服饰
  1807 + - #4 [L3] spu=67852 Cross-border 2024 European and American Spring and Summer New Sleeveless Long Dress Pocket suit INS Leisure Vacation Loose Two-piece Set for Women (rel=190.6998)
  1808 + zh: 跨境2024欧美春季夏季新款无袖长裙口袋套装女士休闲度假宽松两件套
  1809 + - #5 [L3] spu=68828 2025 Summer Niche European and American Ins Splicing Ruffled Tube Top Vacation Long Chiffon Fairy Skirt Dress (rel=170.27315)
  1810 + zh: 2025 夏季小众欧美风拼接荷叶边吊带长款雪纺仙女裙连衣裙
  1811 +
  1812 +### running shorts
  1813 +
  1814 +- Primary_Metric_Score: 0.85507
  1815 +- NDCG@20: 0.978441
  1816 +- NDCG@50: 0.849923
  1817 +- ERR@10: 0.93472
  1818 +- Strong_Precision@10: 1.0
  1819 +- Strong_Precision@20: 0.95
  1820 +- Useful_Precision@50: 1.0
  1821 +- Avg_Grade@10: 3.0
  1822 +- Gain_Recall@20: 0.127473
  1823 +- ERR@10: 0.93472
  1824 +- ERR@20: 0.93472
  1825 +- ERR@5: 0.934715
  1826 +- ERR@50: 0.93472
  1827 +- Exact_Precision@10: 1.0
  1828 +- Exact_Precision@20: 0.95
  1829 +- Exact_Precision@5: 1.0
  1830 +- Exact_Success@10: 1.0
  1831 +- Exact_Success@5: 1.0
  1832 +- Gain_Recall@10: 0.065934
  1833 +- Gain_Recall@50: 0.263736
  1834 +- MRR_Exact@10: 1.0
  1835 +- MRR_Strong@10: 1.0
  1836 +- NDCG@10: 1.0
  1837 +- NDCG@5: 1.0
  1838 +- Strong_Precision@5: 1.0
  1839 +- Strong_Success@10: 1.0
  1840 +- Strong_Success@5: 1.0
  1841 +- Useful_Precision@10: 1.0
  1842 +- Useful_Precision@20: 1.0
  1843 +- Fully Relevant: 51
  1844 +- Mostly Relevant: 19
  1845 +- Weakly Relevant: 25
  1846 +- Irrelevant: 5
  1847 +- Request ID: `fc09e6e4`
  1848 +- Top-10 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L3 | 6:L3 | 7:L3 | 8:L3 | 9:L3 | 10:L3`
  1849 +- Top-20 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L3 | 6:L3 | 7:L3 | 8:L3 | 9:L3 | 10:L3 | 11:L3 | 12:L3 | 13:L3 | 14:L3 | 15:L3 | 16:L3 | 17:L3 | 18:L3 | 19:L3 | 20:L1`
  1850 +- Case Snapshot:
  1851 + - #1 [L3] spu=62284 Ultra Performance Women's Running Shorts 4-Pack Athletic Workout Gym Shorts for Women, with Brief Liner (rel=315.4315)
  1852 + zh: 超性能女士跑步短裤4条装 运动健身短裤 带内衬
  1853 + - #2 [L3] spu=63583 Under Armour Women's Fly by 2.0 Running Shorts (rel=328.50812)
  1854 + zh: 安德玛女士飞驰2.0跑步短裤
  1855 + - #3 [L3] spu=66862 Haimont Women's Running Shorts 2 in 1 High Waisted Athletic Shorts with Drawstring Pockets 3" Compression Liner Shorts (rel=282.65018)
  1856 + zh: Haimont 女士2合1高腰运动短裤带抽绳口袋3英寸压缩内衬短裤
  1857 + - #4 [L3] spu=60648 Mancreda Women's Running Shorts with Liner 3 Zipper Pockets Elastic Workout Athletic Gym Yoga Shorts (rel=310.179)
  1858 + zh: Mancreda 女士跑步短裤带衬里 3个拉链口袋 弹性健身运动瑜伽短裤
  1859 + - #5 [L3] spu=64035 G Gradual Women's Running Shorts with Zipper Pockets Quick Dry Athletic Workout Gym 3" Shorts for Women with Comfy Liner (rel=300.35504)
  1860 + zh: G 女士渐变跑步短裤 带拉链口袋 速干 运动健身 短裤 3英寸 带舒适内衬
  1861 +
  1862 +### pink sweater aesthetic
  1863 +
  1864 +- Primary_Metric_Score: 0.63111
  1865 +- NDCG@20: 0.770568
  1866 +- NDCG@50: 0.748908
  1867 +- ERR@10: 0.667179
  1868 +- Strong_Precision@10: 0.7
  1869 +- Strong_Precision@20: 0.5
  1870 +- Useful_Precision@50: 0.98
  1871 +- Avg_Grade@10: 1.8
  1872 +- Gain_Recall@20: 0.082228
  1873 +- ERR@10: 0.667179
  1874 +- ERR@20: 0.66754
  1875 +- ERR@5: 0.66507
  1876 +- ERR@50: 0.667561
  1877 +- Exact_Precision@10: 0.1
  1878 +- Exact_Precision@20: 0.05
  1879 +- Exact_Precision@5: 0.2
  1880 +- Exact_Success@10: 1.0
  1881 +- Exact_Success@5: 1.0
  1882 +- Gain_Recall@10: 0.047745
  1883 +- Gain_Recall@50: 0.196286
  1884 +- MRR_Exact@10: 0.5
  1885 +- MRR_Strong@10: 1.0
  1886 +- NDCG@10: 0.82221
  1887 +- NDCG@5: 0.86716
  1888 +- Strong_Precision@5: 1.0
  1889 +- Strong_Success@10: 1.0
  1890 +- Strong_Success@5: 1.0
  1891 +- Useful_Precision@10: 1.0
  1892 +- Useful_Precision@20: 1.0
  1893 +- Fully Relevant: 1
  1894 +- Mostly Relevant: 33
  1895 +- Weakly Relevant: 59
  1896 +- Irrelevant: 7
  1897 +- Request ID: `33649a4f`
  1898 +- Top-10 Labels: `1:L2 | 2:L3 | 3:L2 | 4:L2 | 5:L2 | 6:L2 | 7:L2 | 8:L1 | 9:L1 | 10:L1`
  1899 +- Top-20 Labels: `1:L2 | 2:L3 | 3:L2 | 4:L2 | 5:L2 | 6:L2 | 7:L2 | 8:L1 | 9:L1 | 10:L1 | 11:L2 | 12:L1 | 13:L2 | 14:L2 | 15:L1 | 16:L1 | 17:L1 | 18:L1 | 19:L1 | 20:L1`
  1900 +- Case Snapshot:
  1901 + - #1 [L2] spu=66066 Amiblvowa Women Cute Floral Graphic Sweatshirt Teen Girls Y2K Vintage Aesthetic Preppy Pullover Top Oversized Loose Sweater (rel=127.05126)
  1902 + zh: Amiblvowa 女士可爱花卉图案卫衣 青少年女孩 Y2K 复古风学院风套头衫 宽松oversized针织上衣
  1903 + - #2 [L3] spu=65097 Pink Queen Women's 2025 Casual Pullover Sweaters Sexy V Neck Long Sleeve Twist Knot Cropped Knit Sweater Tops (rel=173.5235)
  1904 + zh: 粉色皇后女士2025休闲套头毛衣 性感V领长袖扭结短款针织上衣
  1905 + - #3 [L2] spu=62141 Arach&Cloz Women's Soft Knit Sweater Fall Dressy Casual Pullover Tops (rel=83.701965)
  1906 + zh: Arach&Cloz 女士软质针织套头毛衣 秋季优雅休闲上衣
  1907 + - #4 [L2] spu=62688 Arach&Cloz Women's Soft Knit Sweater Fall Dressy Casual Pullover Tops (rel=83.701965)
  1908 + zh: Arach&Cloz 女士软质针织套头毛衣 秋季优雅休闲上衣
  1909 + - #5 [L2] spu=69444 MARZXIN Women 2025 Casual Holiday Sweaters Long Sleeve Round Neck Valentine Sweater Tops Merry Christmas Sweaters (rel=103.55857)
  1910 + zh: MARZXIN 女士2025休闲假日毛衣 长袖圆领情人节针织上衣 圣诞节毛衣
  1911 +
  1912 +### hiking boots
  1913 +
  1914 +- Primary_Metric_Score: 0.84462
  1915 +- NDCG@20: 0.949032
  1916 +- NDCG@50: 0.836654
  1917 +- ERR@10: 0.93472
  1918 +- Strong_Precision@10: 1.0
  1919 +- Strong_Precision@20: 0.95
  1920 +- Useful_Precision@50: 1.0
  1921 +- Avg_Grade@10: 3.0
  1922 +- Gain_Recall@20: 0.086553
  1923 +- ERR@10: 0.93472
  1924 +- ERR@20: 0.93472
  1925 +- ERR@5: 0.934715
  1926 +- ERR@50: 0.93472
  1927 +- Exact_Precision@10: 1.0
  1928 +- Exact_Precision@20: 0.85
  1929 +- Exact_Precision@5: 1.0
  1930 +- Exact_Success@10: 1.0
  1931 +- Exact_Success@5: 1.0
  1932 +- Gain_Recall@10: 0.046368
  1933 +- Gain_Recall@50: 0.153014
  1934 +- MRR_Exact@10: 1.0
  1935 +- MRR_Strong@10: 1.0
  1936 +- NDCG@10: 1.0
  1937 +- NDCG@5: 1.0
  1938 +- Strong_Precision@5: 1.0
  1939 +- Strong_Success@10: 1.0
  1940 +- Strong_Success@5: 1.0
  1941 +- Useful_Precision@10: 1.0
  1942 +- Useful_Precision@20: 1.0
  1943 +- Fully Relevant: 19
  1944 +- Mostly Relevant: 22
  1945 +- Weakly Relevant: 53
  1946 +- Irrelevant: 6
  1947 +- Request ID: `3e8faffd`
  1948 +- Top-10 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L3 | 6:L3 | 7:L3 | 8:L3 | 9:L3 | 10:L3`
  1949 +- Top-20 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L3 | 6:L3 | 7:L3 | 8:L3 | 9:L3 | 10:L3 | 11:L1 | 12:L3 | 13:L2 | 14:L2 | 15:L3 | 16:L3 | 17:L3 | 18:L3 | 19:L3 | 20:L3`
  1950 +- Case Snapshot:
  1951 + - #1 [L3] spu=62928 Merrell Men's Moab 2 Mid Waterproof Hiking Boot (rel=369.84433)
  1952 + zh: 梅尔维尔男士Moab 2中帮防水徒步靴
  1953 + - #2 [L3] spu=62700 Columbia Women's Newton Ridge Plus Waterproof Hiking Boots (rel=266.3858)
  1954 + zh: 哥伦比亚女士牛顿岭加厚防水登山靴
  1955 + - #3 [L3] spu=65277 NORTIV 8 Women's Waterproof Hiking Boots Outdoor Trekking Camping Trail Hiking Boots (rel=306.06873)
  1956 + zh: NORTIV 8 女士防水登山鞋 户外远足露营徒步鞋
  1957 + - #4 [L3] spu=62956 Timberland Women's Ellendale Hiking Boot (rel=278.76038)
  1958 + zh: 添柏岚 女士艾尔德兰远足靴
  1959 + - #5 [L3] spu=61532 Merrell Women's Moab 3 Mid Waterproof Hiking Boots (rel=368.9157)
  1960 + zh: 梅里尔女士摩亚3中帮防水徒步靴
  1961 +
  1962 +### 宽松开襟羊毛衫
  1963 +
  1964 +- Primary_Metric_Score: 0.823867
  1965 +- NDCG@20: 0.907769
  1966 +- NDCG@50: 0.88433
  1967 +- ERR@10: 0.934715
  1968 +- Strong_Precision@10: 1.0
  1969 +- Strong_Precision@20: 0.9
  1970 +- Useful_Precision@50: 0.94
  1971 +- Avg_Grade@10: 2.7
  1972 +- Gain_Recall@20: 0.124122
  1973 +- ERR@10: 0.934715
  1974 +- ERR@20: 0.934715
  1975 +- ERR@5: 0.93469
  1976 +- ERR@50: 0.934715
  1977 +- Exact_Precision@10: 0.7
  1978 +- Exact_Precision@20: 0.75
  1979 +- Exact_Precision@5: 0.8
  1980 +- Exact_Success@10: 1.0
  1981 +- Exact_Success@5: 1.0
  1982 +- Gain_Recall@10: 0.063232
  1983 +- Gain_Recall@50: 0.229508
  1984 +- MRR_Exact@10: 1.0
  1985 +- MRR_Strong@10: 1.0
  1986 +- NDCG@10: 0.92639
  1987 +- NDCG@5: 0.956265
  1988 +- Strong_Precision@5: 1.0
  1989 +- Strong_Success@10: 1.0
  1990 +- Strong_Success@5: 1.0
  1991 +- Useful_Precision@10: 1.0
  1992 +- Useful_Precision@20: 1.0
  1993 +- Fully Relevant: 21
  1994 +- Mostly Relevant: 9
  1995 +- Weakly Relevant: 48
  1996 +- Irrelevant: 22
  1997 +- Request ID: `174d1597`
  1998 +- Top-10 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L2 | 6:L3 | 7:L3 | 8:L2 | 9:L2 | 10:L3`
  1999 +- Top-20 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L2 | 6:L3 | 7:L3 | 8:L2 | 9:L2 | 10:L3 | 11:L3 | 12:L3 | 13:L3 | 14:L3 | 15:L3 | 16:L1 | 17:L3 | 18:L3 | 19:L3 | 20:L1`
  2000 +- Case Snapshot:
  2001 + - #1 [L3] spu=64300 Micoson Women's Long Sleeve Open Front Cardigan Casual Loose Lightweight Cardigans with Pockets (rel=115.4416)
  2002 + zh: Micoson 女士长袖开衫休闲宽松轻便带口袋针织开衫
  2003 + - #2 [L3] spu=65956 Micoson Women's Long Sleeve Open Front Cardigan Casual Loose Lightweight Cardigans with Pockets (rel=115.4416)
  2004 + zh: Micoson 女士长袖开衫休闲宽松轻便带口袋针织开衫
  2005 + - #3 [L3] spu=63285 Dokotoo Women's Long Open Front Cardigans Striped Color Block Loose Knit Sweaters Outwear Coat (rel=146.14777)
  2006 + zh: Dokotoo 女士长款开襟条纹拼色宽松针织开衫外套
  2007 + - #4 [L3] spu=62204 LILLUSORY Womens Oversized Cardigans Soft Knit Cardigan Sweater with Pockets (rel=89.173615)
  2008 + zh: LILLUSORY 女士宽松针织开衫 带口袋柔软针织毛衣
  2009 + - #5 [L2] spu=66267 Womens Flannel Cardigan Sweaters Trendy Casual Lightweight Plaid Jacket Loose Long Sleeve Kimono Fashion Fall Outfits (rel=218.55011)
  2010 + zh: 女式法兰绒开衫毛衣 时尚休闲 轻盈格子外套 宽松长袖开襟衫 时尚秋季穿搭
  2011 +
  2012 +### business casual women
  2013 +
  2014 +- Primary_Metric_Score: 0.858477
  2015 +- NDCG@20: 0.978441
  2016 +- NDCG@50: 0.983579
  2017 +- ERR@10: 0.93472
  2018 +- Strong_Precision@10: 1.0
  2019 +- Strong_Precision@20: 0.95
  2020 +- Useful_Precision@50: 1.0
  2021 +- Avg_Grade@10: 3.0
  2022 +- Gain_Recall@20: 0.021076
  2023 +- ERR@10: 0.93472
  2024 +- ERR@20: 0.93472
  2025 +- ERR@5: 0.934715
  2026 +- ERR@50: 0.93472
  2027 +- Exact_Precision@10: 1.0
  2028 +- Exact_Precision@20: 0.95
  2029 +- Exact_Precision@5: 1.0
  2030 +- Exact_Success@10: 1.0
  2031 +- Exact_Success@5: 1.0
  2032 +- Gain_Recall@10: 0.010901
  2033 +- Gain_Recall@50: 0.053416
  2034 +- MRR_Exact@10: 1.0
  2035 +- MRR_Strong@10: 1.0
  2036 +- NDCG@10: 1.0
  2037 +- NDCG@5: 1.0
  2038 +- Strong_Precision@5: 1.0
  2039 +- Strong_Success@10: 1.0
  2040 +- Strong_Success@5: 1.0
  2041 +- Useful_Precision@10: 1.0
  2042 +- Useful_Precision@20: 1.0
  2043 +- Fully Relevant: 68
  2044 +- Mostly Relevant: 8
  2045 +- Weakly Relevant: 21
  2046 +- Irrelevant: 3
  2047 +- Request ID: `3a67c47f`
  2048 +- Top-10 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L3 | 6:L3 | 7:L3 | 8:L3 | 9:L3 | 10:L3`
  2049 +- Top-20 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L3 | 6:L3 | 7:L3 | 8:L3 | 9:L3 | 10:L3 | 11:L3 | 12:L3 | 13:L3 | 14:L3 | 15:L3 | 16:L3 | 17:L3 | 18:L3 | 19:L3 | 20:L1`
  2050 +- Case Snapshot:
  2051 + - #1 [L3] spu=60757 LookbookStore Blazers for Women Suit Jackets Dressy 3/4 Sleeve Blazer Business Casual Outfits for Work (rel=145.89621)
  2052 + zh: LookbookStore 女士西装外套 修身3/4袖商务休闲连衣裙套装 工作服
  2053 + - #2 [L3] spu=67188 AUTOMET Long Sleeve Shirts Womens Pleated Business Casual Blouses with Smocked Cuffs (rel=241.85126)
  2054 + zh: AUTOMET 女士长袖褶皱商务休闲衬衣带抽褶袖口
  2055 + - #3 [L3] spu=62029 iChosy Women's Stretchy Straight Leg Dress Work Pants Business Office Casual Slacks with Pockets (rel=150.6585)
  2056 + zh: iChosy 女士弹力直筒办公裤 商务休闲裤 带口袋
  2057 + - #4 [L3] spu=66683 Floerns Women's Elegant Flare Long Sleeve Shirts Button Down Business Casual Work Blouse (rel=160.58844)
  2058 + zh: Floerns 女士优雅喇叭袖长袖衬衫 休闲商务工作衬衣
  2059 + - #5 [L3] spu=62327 KIRUNDO Women Suits 2 Piece Set Business Casual Dressy Oversized Blazer Jacket and Wide Leg Dress Pantsuits Formal Outfits (rel=142.06001)
  2060 + zh: KIRUNDO 女士两件套西装 商务休闲风 大廓形西装外套+阔腿连身裤 正式穿搭
  2061 +
  2062 +### a-line dress
  2063 +
  2064 +- Primary_Metric_Score: 0.801775
  2065 +- NDCG@20: 0.959218
  2066 +- NDCG@50: 0.777362
  2067 +- ERR@10: 0.93464
  2068 +- Strong_Precision@10: 0.9
  2069 +- Strong_Precision@20: 0.95
  2070 +- Useful_Precision@50: 0.92
  2071 +- Avg_Grade@10: 2.8
  2072 +- Gain_Recall@20: 0.039645
  2073 +- ERR@10: 0.93464
  2074 +- ERR@20: 0.93464
  2075 +- ERR@5: 0.934605
  2076 +- ERR@50: 0.93464
  2077 +- Exact_Precision@10: 0.9
  2078 +- Exact_Precision@20: 0.95
  2079 +- Exact_Precision@5: 0.8
  2080 +- Exact_Success@10: 1.0
  2081 +- Exact_Success@5: 1.0
  2082 +- Gain_Recall@10: 0.019139
  2083 +- Gain_Recall@50: 0.073821
  2084 +- MRR_Exact@10: 1.0
  2085 +- MRR_Strong@10: 1.0
  2086 +- NDCG@10: 0.936808
  2087 +- NDCG@5: 0.902621
  2088 +- Strong_Precision@5: 0.8
  2089 +- Strong_Success@10: 1.0
  2090 +- Strong_Success@5: 1.0
  2091 +- Useful_Precision@10: 1.0
  2092 +- Useful_Precision@20: 1.0
  2093 +- Fully Relevant: 40
  2094 +- Mostly Relevant: 22
  2095 +- Weakly Relevant: 31
  2096 +- Irrelevant: 7
  2097 +- Request ID: `ea19d61e`
  2098 +- Top-10 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L1 | 5:L3 | 6:L3 | 7:L3 | 8:L3 | 9:L3 | 10:L3`
  2099 +- Top-20 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L1 | 5:L3 | 6:L3 | 7:L3 | 8:L3 | 9:L3 | 10:L3 | 11:L3 | 12:L3 | 13:L3 | 14:L3 | 15:L3 | 16:L3 | 17:L3 | 18:L3 | 19:L3 | 20:L3`
  2100 +- Case Snapshot:
  2101 + - #1 [L3] spu=60642 Womens Plaid A-line Dresses Shoulder Straps Ruffle Hem Casual Mini Dress with Side Pocket (rel=209.55156)
  2102 + zh: 女士格子A字裙 一字肩 雪纺荷叶边下摆 带侧袋 休闲短款连衣裙
  2103 + - #2 [L3] spu=67262 CLOCOR Women's Plus Size Midi Dress 3/4 Sleeve A-Line Swing Dress V Neck Flowy Casual Dresses (rel=187.78137)
  2104 + zh: CLOCOR 女士加大码中长款3/4袖A字摆飘逸连衣裙 无袖V领休闲裙
  2105 + - #3 [L3] spu=62985 ANRABESS Womens Dress Long Lantern Sleeve Square Neck Elastic Waist Ruffle Flowy Swing A-Line Short Dresses 2025 Fall Fashion (rel=180.43378)
  2106 + zh: ANRABESS 女士长灯笼袖方领弹力腰身荷叶边飘逸A字短款连衣裙 2025秋季时尚
  2107 + - #4 [L1] spu=68971 round neck elegant waist large swing puff sleeve A- line skirt African dress (rel=195.65137)
  2108 + zh: 圆领优雅腰线大摆泡泡袖A字裙 非洲风连衣裙
  2109 + - #5 [L3] spu=64062 Quedoris Girls Ruffle Trim Dress Print and Solid Color A-line Swing Flared Belted Casual Party Dress with Zipper (rel=193.26231)
  2110 + zh: Quedoris 女孩荷叶边镶边印花纯色A字摆收腰休闲派对连衣裙拉链款
  2111 +
  2112 +### 涤纶短裤
  2113 +
  2114 +- Primary_Metric_Score: 0.342325
  2115 +- NDCG@20: 0.357714
  2116 +- NDCG@50: 0.451464
  2117 +- ERR@10: 0.330695
  2118 +- Strong_Precision@10: 0.2
  2119 +- Strong_Precision@20: 0.15
  2120 +- Useful_Precision@50: 0.8
  2121 +- Avg_Grade@10: 1.2
  2122 +- Gain_Recall@20: 0.048724
  2123 +- ERR@10: 0.330695
  2124 +- ERR@20: 0.338745
  2125 +- ERR@5: 0.300812
  2126 +- ERR@50: 0.339094
  2127 +- Exact_Precision@10: 0.0
  2128 +- Exact_Precision@20: 0.05
  2129 +- Exact_Precision@5: 0.0
  2130 +- Exact_Success@10: 0.0
  2131 +- Exact_Success@5: 0.0
  2132 +- Gain_Recall@10: 0.027842
  2133 +- Gain_Recall@50: 0.139211
  2134 +- MRR_Exact@10: 0.0
  2135 +- MRR_Strong@10: 0.333333
  2136 +- NDCG@10: 0.3921
  2137 +- NDCG@5: 0.38986
  2138 +- Strong_Precision@5: 0.2
  2139 +- Strong_Success@10: 1.0
  2140 +- Strong_Success@5: 1.0
  2141 +- Useful_Precision@10: 1.0
  2142 +- Useful_Precision@20: 0.85
  2143 +- Fully Relevant: 12
  2144 +- Mostly Relevant: 22
  2145 +- Weakly Relevant: 45
  2146 +- Irrelevant: 21
  2147 +- Request ID: `bed947f1`
  2148 +- Top-10 Labels: `1:L1 | 2:L1 | 3:L2 | 4:L1 | 5:L1 | 6:L1 | 7:L1 | 8:L1 | 9:L2 | 10:L1`
  2149 +- Top-20 Labels: `1:L1 | 2:L1 | 3:L2 | 4:L1 | 5:L1 | 6:L1 | 7:L1 | 8:L1 | 9:L2 | 10:L1 | 11:L1 | 12:L0 | 13:L1 | 14:L1 | 15:L1 | 16:L1 | 17:L0 | 18:L1 | 19:L0 | 20:L3`
  2150 +- Case Snapshot:
  2151 + - #1 [L1] spu=64742 Women's 3"/5" High Waisted Biker Shorts - Spandex Yoga, Workout, Cycling, Volleyball, Dance | Athletic Booty Shorts (rel=140.14108)
  2152 + zh: 女士3英寸/5英寸高腰骑行短裤 - 涤纶瑜伽、健身、骑行、排球、舞蹈运动短裤 | 运动翘臀短裤
  2153 + - #2 [L1] spu=64745 maamgic Mens Shorts Casual 4 Inch Cotton Casual Shorts for Men Elastic Waistband Mens Casual Shorts Daily Wear (rel=75.25593)
  2154 + zh: maamgic 男士休闲短裤 4英寸纯棉弹性腰头男式日常穿着休闲短裤
  2155 + - #3 [L2] spu=64479 The Children's Place Boys Athletic Basketball Shorts (rel=108.28801)
  2156 + zh: 儿童乐园 男孩运动篮球短裤
  2157 + - #4 [L1] spu=69304 Cameway 4 Pack Women's Cotton Yoga Dance Short Pants Sport Shorts Summer Athletic Cycling Hiking Sports Shorts (rel=78.76861)
  2158 + zh: Cameway 4条装 女士纯棉瑜伽舞蹈短裤 运动短裤 夏季健身骑行登山运动短裤
  2159 + - #5 [L1] spu=67468 Cameway 4 Pack Women's Cotton Yoga Dance Short Pants Sport Shorts Summer Athletic Cycling Hiking Sports Shorts (rel=78.76861)
  2160 + zh: Cameway 4条装 女士纯棉瑜伽舞蹈短裤 运动短裤 夏季健身骑行登山运动短裤
  2161 +
  2162 +### Compression Top Spandex
  2163 +
  2164 +- Primary_Metric_Score: 0.475714
  2165 +- NDCG@20: 0.536085
  2166 +- NDCG@50: 0.386036
  2167 +- ERR@10: 0.934626
  2168 +- Strong_Precision@10: 0.6
  2169 +- Strong_Precision@20: 0.4
  2170 +- Useful_Precision@50: 0.32
  2171 +- Avg_Grade@10: 1.8
  2172 +- Gain_Recall@20: 0.028969
  2173 +- ERR@10: 0.934626
  2174 +- ERR@20: 0.934626
  2175 +- ERR@5: 0.934587
  2176 +- ERR@50: 0.934626
  2177 +- Exact_Precision@10: 0.6
  2178 +- Exact_Precision@20: 0.4
  2179 +- Exact_Precision@5: 0.8
  2180 +- Exact_Success@10: 1.0
  2181 +- Exact_Success@5: 1.0
  2182 +- Gain_Recall@10: 0.020857
  2183 +- Gain_Recall@50: 0.04635
  2184 +- MRR_Exact@10: 1.0
  2185 +- MRR_Strong@10: 1.0
  2186 +- NDCG@10: 0.701973
  2187 +- NDCG@5: 0.853932
  2188 +- Strong_Precision@5: 0.8
  2189 +- Strong_Success@10: 1.0
  2190 +- Strong_Success@5: 1.0
  2191 +- Useful_Precision@10: 0.6
  2192 +- Useful_Precision@20: 0.45
  2193 +- Fully Relevant: 23
  2194 +- Mostly Relevant: 0
  2195 +- Weakly Relevant: 15
  2196 +- Irrelevant: 62
  2197 +- Request ID: `03252a24`
  2198 +- Top-10 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L0 | 5:L3 | 6:L3 | 7:L0 | 8:L3 | 9:L0 | 10:L0`
  2199 +- Top-20 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L0 | 5:L3 | 6:L3 | 7:L0 | 8:L3 | 9:L0 | 10:L0 | 11:L0 | 12:L1 | 13:L0 | 14:L0 | 15:L3 | 16:L3 | 17:L0 | 18:L0 | 19:L0 | 20:L0`
  2200 +- Case Snapshot:
  2201 + - #1 [L3] spu=64991 ARMSTRONG AMERICA Compression Shirt for Men | Gynecomastia Compression Tank Top Men | Mens Shapewear Compression Shirts (rel=172.81119)
  2202 + zh: 美国阿姆斯特朗男士压缩衣 | 男性乳腺发育专用压缩背心 | 男士塑身压缩上衣
  2203 + - #2 [L3] spu=66302 FeelinGirl Women Tank Tops Shapewear: Tummy Control Compression Tank V Neck Seamless Body Shaper Camisole Tops for Women (rel=134.56929)
  2204 + zh: FeelinGirl 女士背心式塑身衣：腹部收紧压缩露背领无痕塑身背心女士吊带上衣
  2205 + - #3 [L3] spu=66247 JOYSHAPER Shapewear Camisole with Built in Bra Compression Halter Tops for Women Tummy Control Shapewear Tank Top Padded Bras (rel=132.43434)
  2206 + zh: JOYSHAPER 一体式文胸塑身背心 女士收腹塑身吊带上衣 加厚衬垫文胸
  2207 + - #4 [L0] spu=61395 CRZ YOGA Women's Naked Feeling Biker Shorts with Pockets 6'' - High Waisted Yoga Gym Workout Spandex (rel=121.86321)
  2208 + zh: CRZ YOGA 女士裸感带袋高腰瑜伽健身运动短裤 6英寸 - 氨纶
  2209 + - #5 [L3] spu=65841 EUYZOU Women Shapewear Tummy Control Tank Tops Seamless Compression Tops Body Shaper Camisole (rel=145.10472)
  2210 + zh: EUYZOU 女士无缝塑身收腹背心 紧身压缩上衣 身体塑形吊带上衣
  2211 +
  2212 +### skiing trip insulated base layer
  2213 +
  2214 +- Primary_Metric_Score: 0.155851
  2215 +- NDCG@20: 0.185628
  2216 +- NDCG@50: 0.306271
  2217 +- ERR@10: 0.0
  2218 +- Strong_Precision@10: 0.0
  2219 +- Strong_Precision@20: 0.25
  2220 +- Useful_Precision@50: 0.48
  2221 +- Avg_Grade@10: 0.0
  2222 +- Gain_Recall@20: 0.024911
  2223 +- ERR@10: 0.0
  2224 +- ERR@20: 0.087884
  2225 +- ERR@5: 0.0
  2226 +- ERR@50: 0.088016
  2227 +- Exact_Precision@10: 0.0
  2228 +- Exact_Precision@20: 0.1
  2229 +- Exact_Precision@5: 0.0
  2230 +- Exact_Success@10: 0.0
  2231 +- Exact_Success@5: 0.0
  2232 +- Gain_Recall@10: 0.0
  2233 +- Gain_Recall@50: 0.078292
  2234 +- MRR_Exact@10: 0.0
  2235 +- MRR_Strong@10: 0.0
  2236 +- NDCG@10: 0.0
  2237 +- NDCG@5: 0.0
  2238 +- Strong_Precision@5: 0.0
  2239 +- Strong_Success@10: 0.0
  2240 +- Strong_Success@5: 0.0
  2241 +- Useful_Precision@10: 0.0
  2242 +- Useful_Precision@20: 0.35
  2243 +- Fully Relevant: 10
  2244 +- Mostly Relevant: 10
  2245 +- Weakly Relevant: 39
  2246 +- Irrelevant: 41
  2247 +- Request ID: `63a9678e`
  2248 +- Top-10 Labels: `1:L0 | 2:L0 | 3:L0 | 4:L0 | 5:L0 | 6:L0 | 7:L0 | 8:L0 | 9:L0 | 10:L0`
  2249 +- Top-20 Labels: `1:L0 | 2:L0 | 3:L0 | 4:L0 | 5:L0 | 6:L0 | 7:L0 | 8:L0 | 9:L0 | 10:L0 | 11:L3 | 12:L1 | 13:L0 | 14:L2 | 15:L2 | 16:L2 | 17:L3 | 18:L0 | 19:L1 | 20:L0`
  2250 +- Case Snapshot:
  2251 + - #1 [L0] spu=63403 Amazon Essentials Men's Waterproof Insulated Snow Ski Pant (rel=137.66924)
  2252 + zh: 亚马逊精选 男款防水保暖滑雪裤
  2253 + - #2 [L0] spu=64255 Heathyoga Snow Ski Pants Women Waterproof Softshell Insulated Fleece Lined Snowboard Pants Hiking Pants for Winter Outdoor (rel=130.73956)
  2254 + zh: Heathyoga 女士滑雪裤 防水软壳加绒保暖滑雪裤 登山冬装户外裤
  2255 + - #3 [L0] spu=66424 Heathyoga Snow Ski Pants Women Waterproof Softshell Insulated Fleece Lined Snowboard Pants Hiking Pants for Winter Outdoor (rel=130.73956)
  2256 + zh: Heathyoga 女士滑雪裤 防水软壳加绒保暖滑雪裤 登山冬装户外裤
  2257 + - #4 [L0] spu=67847 GSOU SNOW Womens Ski Suit One Piece Snowsuit Snowboard Slim Insulated Jumpsuit Jacket Waterproof Windproof for Outdoor Sports (rel=130.49467)
  2258 + zh: GSOU SNOW 女士滑雪服 一体式滑雪服 滑雪板保暖连体服 防水防风户外运动服
  2259 + - #5 [L0] spu=64544 GSOU SNOW Womens Ski Suit One Piece Snowsuit Snowboard Slim Insulated Jumpsuit Jacket Waterproof Windproof for Outdoor Sports (rel=130.49467)
  2260 + zh: GSOU SNOW 女士滑雪服 一体式滑雪服 滑雪板保暖连体服 防水防风户外运动服
  2261 +
  2262 +### high waisted jeans
  2263 +
  2264 +- Primary_Metric_Score: 0.832185
  2265 +- NDCG@20: 0.919413
  2266 +- NDCG@50: 0.912058
  2267 +- ERR@10: 0.93472
  2268 +- Strong_Precision@10: 1.0
  2269 +- Strong_Precision@20: 0.85
  2270 +- Useful_Precision@50: 0.96
  2271 +- Avg_Grade@10: 3.0
  2272 +- Gain_Recall@20: 0.081288
  2273 +- ERR@10: 0.93472
  2274 +- ERR@20: 0.93472
  2275 +- ERR@5: 0.934715
  2276 +- ERR@50: 0.93472
  2277 +- Exact_Precision@10: 1.0
  2278 +- Exact_Precision@20: 0.85
  2279 +- Exact_Precision@5: 1.0
  2280 +- Exact_Success@10: 1.0
  2281 +- Exact_Success@5: 1.0
  2282 +- Gain_Recall@10: 0.046012
  2283 +- Gain_Recall@50: 0.205521
  2284 +- MRR_Exact@10: 1.0
  2285 +- MRR_Strong@10: 1.0
  2286 +- NDCG@10: 1.0
  2287 +- NDCG@5: 1.0
  2288 +- Strong_Precision@5: 1.0
  2289 +- Strong_Success@10: 1.0
  2290 +- Strong_Success@5: 1.0
  2291 +- Useful_Precision@10: 1.0
  2292 +- Useful_Precision@20: 0.95
  2293 +- Fully Relevant: 68
  2294 +- Mostly Relevant: 10
  2295 +- Weakly Relevant: 18
  2296 +- Irrelevant: 4
  2297 +- Request ID: `14adfd26`
  2298 +- Top-10 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L3 | 6:L3 | 7:L3 | 8:L3 | 9:L3 | 10:L3`
  2299 +- Top-20 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L3 | 6:L3 | 7:L3 | 8:L3 | 9:L3 | 10:L3 | 11:L3 | 12:L3 | 13:L3 | 14:L3 | 15:L0 | 16:L1 | 17:L3 | 18:L3 | 19:L1 | 20:L3`
  2300 +- Case Snapshot:
  2301 + - #1 [L3] spu=68598 Factory Direct Sales European and American Retro Deconstructed Workwear Patch Pocket Washed Curved High Waist Jeans for Women (rel=375.02414)
  2302 + zh: 工厂直销欧美复古解构风工装拼接口袋水洗做旧高腰女式牛仔裤
  2303 + - #2 [L3] spu=68659 Amazon European and American Cross-Border High-Waisted Jeans for Women, Spring and Autumn Style, Slimming Wide-Leg Vintage Elegant Straight-Leg Pants (rel=271.1832)
  2304 + zh: 亚马逊欧美跨境女士高腰裤，春秋季款显瘦阔腿复古优雅直筒裤
  2305 + - #3 [L3] spu=62774 Sidefeel Women's High Waisted Jeans Strechy Fashion Raw Hem Straight Leg Ankle Denim Pants with Pockets (rel=376.62292)
  2306 + zh: Sidefeel 女士高腰修身时尚破边直筒牛仔裤带口袋
  2307 + - #4 [L3] spu=60808 Sidefeel Women's High Waisted Jeans Strechy Fashion Raw Hem Straight Leg Ankle Denim Pants with Pockets (rel=375.96677)
  2308 + zh: Sidefeel 女士高腰修身时尚破边直筒牛仔裤带口袋
  2309 + - #5 [L3] spu=68722 Cross-Border European and American Export Amazon Wish Aliexpress 2025 Autum New Casual Wide-Leg High-Waist Jeans for Women (rel=291.96262)
  2310 + zh: 跨境欧美出口亚马逊心愿单阿里速卖通2025秋季新款女式休闲高腰阔腿牛仔裤
  2311 +
  2312 +### 无袖夏装
  2313 +
  2314 +- Primary_Metric_Score: 0.847091
  2315 +- NDCG@20: 0.94844
  2316 +- NDCG@50: 0.971856
  2317 +- ERR@10: 0.93472
  2318 +- Strong_Precision@10: 1.0
  2319 +- Strong_Precision@20: 0.95
  2320 +- Useful_Precision@50: 0.98
  2321 +- Avg_Grade@10: 2.9
  2322 +- Gain_Recall@20: 0.025045
  2323 +- ERR@10: 0.93472
  2324 +- ERR@20: 0.93472
  2325 +- ERR@5: 0.934715
  2326 +- ERR@50: 0.93472
  2327 +- Exact_Precision@10: 0.9
  2328 +- Exact_Precision@20: 0.9
  2329 +- Exact_Precision@5: 1.0
  2330 +- Exact_Success@10: 1.0
  2331 +- Exact_Success@5: 1.0
  2332 +- Gain_Recall@10: 0.01297
  2333 +- Gain_Recall@50: 0.065295
  2334 +- MRR_Exact@10: 1.0
  2335 +- MRR_Strong@10: 1.0
  2336 +- NDCG@10: 0.977915
  2337 +- NDCG@5: 1.0
  2338 +- Strong_Precision@5: 1.0
  2339 +- Strong_Success@10: 1.0
  2340 +- Strong_Success@5: 1.0
  2341 +- Useful_Precision@10: 1.0
  2342 +- Useful_Precision@20: 0.95
  2343 +- Fully Relevant: 93
  2344 +- Mostly Relevant: 1
  2345 +- Weakly Relevant: 0
  2346 +- Irrelevant: 6
  2347 +- Request ID: `48654b11`
  2348 +- Top-10 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L3 | 6:L3 | 7:L3 | 8:L3 | 9:L2 | 10:L3`
  2349 +- Top-20 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L3 | 6:L3 | 7:L3 | 8:L3 | 9:L2 | 10:L3 | 11:L3 | 12:L3 | 13:L0 | 14:L3 | 15:L3 | 16:L3 | 17:L3 | 18:L3 | 19:L3 | 20:L3`
  2350 +- Case Snapshot:
  2351 + - #1 [L3] spu=62471 Summer Dresses for Women Sleeveless Lace Crewneck Sundress (S-3XL) (rel=216.59616)
  2352 + zh: 女士夏季无袖蕾丝圆领连衣裙（S-3XL）
  2353 + - #2 [L3] spu=68811 Amazon Independent Station Summer European and American Foreign Trade 19 Color Pocket Sleeveless Crewneck Women's Cotton and Linen dress in stock (rel=160.20229)
  2354 + zh: 亚马逊独立站夏季欧美外贸19色口袋无袖圆领女式棉麻连衣裙现货
  2355 + - #3 [L3] spu=68804 Japanese and Korean New Stitching Long Sleeveless Summer dress Women's Design Sense Slim-fit Slimming Large Skirt Elegant Long Dress (rel=174.1059)
  2356 + zh: 日韩新款拼接无袖夏季连衣裙 女士设计感修身显瘦大摆长裙 优雅长裙
  2357 + - #4 [L3] spu=66116 Womens Tank Casual V Neck Summer Spring Beach Vacation Clothes Loose Fit Cute Outfit 2026 Fashion Sleeveless Tops (rel=141.19731)
  2358 + zh: 女式休闲V领夏装春装沙滩度假宽松可爱套装2026新款无袖上衣
  2359 + - #5 [L3] spu=63753 Womens Plus Size Tank Tops Summer Sleeveless Henley T-Shirts Tops Casual Button Down Tunics Shirts (rel=144.86533)
  2360 + zh: 女装加大码夏装无袖亨利领短袖上衣 休闲纽扣开衫连身裙衫
  2361 +
  2362 +### 雪纺衬衫
  2363 +
  2364 +- Primary_Metric_Score: 0.816924
  2365 +- NDCG@20: 0.940659
  2366 +- NDCG@50: 0.882856
  2367 +- ERR@10: 0.934713
  2368 +- Strong_Precision@10: 0.9
  2369 +- Strong_Precision@20: 0.9
  2370 +- Useful_Precision@50: 0.96
  2371 +- Avg_Grade@10: 2.8
  2372 +- Gain_Recall@20: 0.083832
  2373 +- ERR@10: 0.934713
  2374 +- ERR@20: 0.934713
  2375 +- ERR@5: 0.934678
  2376 +- ERR@50: 0.934713
  2377 +- Exact_Precision@10: 0.9
  2378 +- Exact_Precision@20: 0.9
  2379 +- Exact_Precision@5: 0.8
  2380 +- Exact_Success@10: 1.0
  2381 +- Exact_Success@5: 1.0
  2382 +- Gain_Recall@10: 0.041916
  2383 +- Gain_Recall@50: 0.193114
  2384 +- MRR_Exact@10: 1.0
  2385 +- MRR_Strong@10: 1.0
  2386 +- NDCG@10: 0.943238
  2387 +- NDCG@5: 0.91253
  2388 +- Strong_Precision@5: 0.8
  2389 +- Strong_Success@10: 1.0
  2390 +- Strong_Success@5: 1.0
  2391 +- Useful_Precision@10: 1.0
  2392 +- Useful_Precision@20: 1.0
  2393 +- Fully Relevant: 50
  2394 +- Mostly Relevant: 15
  2395 +- Weakly Relevant: 15
  2396 +- Irrelevant: 20
  2397 +- Request ID: `b829de30`
  2398 +- Top-10 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L1 | 6:L3 | 7:L3 | 8:L3 | 9:L3 | 10:L3`
  2399 +- Top-20 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L1 | 6:L3 | 7:L3 | 8:L3 | 9:L3 | 10:L3 | 11:L3 | 12:L3 | 13:L3 | 14:L3 | 15:L3 | 16:L3 | 17:L1 | 18:L3 | 19:L3 | 20:L3`
  2400 +- Case Snapshot:
  2401 + - #1 [L3] spu=68166 Fashion Unique Summer Women's French-style Loose Chiffon Short Sleeve Shirt with Peplum and Open Front Outerwear (rel=434.81284)
  2402 + zh: 设计感小众短袖雪纺衬衫女夏季法式宽松气质小飞袖开衫外搭上衣潮
  2403 + - #2 [L3] spu=68126 Spot New Women's Printed Off-shoulder Summer Chiffon Shirt Top T-shirt Short-sleeved Women's Chiffon Shirt (rel=541.52893)
  2404 + zh: 新款女装印花露肩夏季雪纺衫上衣 短袖雪纺衬衫
  2405 + - #3 [L3] spu=68018 Floral Chiffon Blouse, Women's Long Sleeve Spring 2026 New Arrival Retro Chic Shirt Fashion Youthful Pretty Top (rel=390.35245)
  2406 + zh: 碎花雪纺衬衫女士长袖春季2026新款复古洋气衬衣时尚减龄漂亮上衣
  2407 + - #4 [L3] spu=68003 2026 Spring/Autumn New Bohemian Print Chiffon Blouse, Women's Stand Collar Top, Unique Style (rel=430.03467)
  2408 + zh: 洋气印花雪纺衬衫2026年春秋季新款小众别致小衫女士立领上衣
  2409 + - #5 [L1] spu=68168 Elegant Gray Chiffon Sun Protection Top for Women, Lightweight Summer Long-Sleeve Outer Layer, Flowy Fashion Shirt (rel=389.884)
  2410 + zh: 高级感灰色雪纺防晒衣女夏季薄款外套垂感长袖外搭罩衫雪纺衬衫潮
  2411 +
  2412 +### convertible zip-off hiking pants
  2413 +
  2414 +- Primary_Metric_Score: 0.610462
  2415 +- NDCG@20: 0.834008
  2416 +- NDCG@50: 0.806542
  2417 +- ERR@10: 0.934716
  2418 +- Strong_Precision@10: 0.5
  2419 +- Strong_Precision@20: 0.25
  2420 +- Useful_Precision@50: 0.68
  2421 +- Avg_Grade@10: 1.9
  2422 +- Gain_Recall@20: 0.245098
  2423 +- ERR@10: 0.934716
  2424 +- ERR@20: 0.934717
  2425 +- ERR@5: 0.934715
  2426 +- ERR@50: 0.934717
  2427 +- Exact_Precision@10: 0.5
  2428 +- Exact_Precision@20: 0.25
  2429 +- Exact_Precision@5: 1.0
  2430 +- Exact_Success@10: 1.0
  2431 +- Exact_Success@5: 1.0
  2432 +- Gain_Recall@10: 0.186275
  2433 +- Gain_Recall@50: 0.460784
  2434 +- MRR_Exact@10: 1.0
  2435 +- MRR_Strong@10: 1.0
  2436 +- NDCG@10: 0.88463
  2437 +- NDCG@5: 1.0
  2438 +- Strong_Precision@5: 1.0
  2439 +- Strong_Success@10: 1.0
  2440 +- Strong_Success@5: 1.0
  2441 +- Useful_Precision@10: 0.9
  2442 +- Useful_Precision@20: 0.75
  2443 +- Fully Relevant: 5
  2444 +- Mostly Relevant: 3
  2445 +- Weakly Relevant: 43
  2446 +- Irrelevant: 49
  2447 +- Request ID: `3cd4a421`
  2448 +- Top-10 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L3 | 6:L1 | 7:L1 | 8:L0 | 9:L1 | 10:L1`
  2449 +- Top-20 Labels: `1:L3 | 2:L3 | 3:L3 | 4:L3 | 5:L3 | 6:L1 | 7:L1 | 8:L0 | 9:L1 | 10:L1 | 11:L1 | 12:L1 | 13:L0 | 14:L0 | 15:L1 | 16:L1 | 17:L0 | 18:L0 | 19:L1 | 20:L1`
  2450 +- Case Snapshot:
  2451 + - #1 [L3] spu=69314 Moosehill Men's-Hiking-Pants Convertible Quick-Dry Water-Resistant Lightweight Zip-Off Outdoor with 5 Deep Pockets (rel=338.48965)
  2452 + zh: Moosehill 男士可拆卸快干防水轻便徒步裤 5个深袋户外运动裤
  2453 + - #2 [L3] spu=67526 Moosehill Men's-Hiking-Pants Convertible Quick-Dry Water-Resistant Lightweight Zip-Off Outdoor with 5 Deep Pockets (rel=338.48965)
  2454 + zh: Moosehill 男士可拆卸快干防水轻便徒步裤 5个深袋户外运动裤
  2455 + - #3 [L3] spu=63198 Cycorld Women's-Hiking-Pants-Convertible Quick-Dry-Stretch-Lightweight Zip-Off Outdoor Pants with 5 Deep Pockets (rel=344.77582)
  2456 + zh: Cycorld 女士可拆卸快干弹力轻便户外登山裤 5个深袋
  2457 + - #4 [L3] spu=67247 Mammut Womens Outdoor Hiking Zip-Off Pants (rel=284.5376)
  2458 + zh: 猛犸象女士户外徒步拉链拆卸裤
  2459 + - #5 [L3] spu=60961 Mammut Womens Outdoor Hiking Zip-Off Pants (rel=284.02078)
  2460 + zh: 猛犸象女士户外徒步拉链拆卸裤
  2461 +
  2462 +### petite summer linen shorts
  2463 +
  2464 +- Primary_Metric_Score: 0.421571
  2465 +- NDCG@20: 0.571728
  2466 +- NDCG@50: 0.526551
  2467 +- ERR@10: 0.539904
  2468 +- Strong_Precision@10: 0.3
  2469 +- Strong_Precision@20: 0.3
  2470 +- Useful_Precision@50: 0.68
  2471 +- Avg_Grade@10: 1.1
  2472 +- Gain_Recall@20: 0.087719
  2473 +- ERR@10: 0.539904
  2474 +- ERR@20: 0.547929
  2475 +- ERR@5: 0.519145
  2476 +- ERR@50: 0.548747
  2477 +- Exact_Precision@10: 0.0
  2478 +- Exact_Precision@20: 0.0
  2479 +- Exact_Precision@5: 0.0
  2480 +- Exact_Success@10: 0.0
  2481 +- Exact_Success@5: 0.0
  2482 +- Gain_Recall@10: 0.048246
  2483 +- Gain_Recall@50: 0.210526
  2484 +- MRR_Exact@10: 0.0
  2485 +- MRR_Strong@10: 1.0
  2486 +- NDCG@10: 0.630834
  2487 +- NDCG@5: 0.710971
  2488 +- Strong_Precision@5: 0.4
  2489 +- Strong_Success@10: 1.0
  2490 +- Strong_Success@5: 1.0
  2491 +- Useful_Precision@10: 0.8
  2492 +- Useful_Precision@20: 0.7
  2493 +- Fully Relevant: 0
  2494 +- Mostly Relevant: 25
  2495 +- Weakly Relevant: 35
  2496 +- Irrelevant: 40
  2497 +- Request ID: `45ff1496`
  2498 +- Top-10 Labels: `1:L2 | 2:L2 | 3:L1 | 4:L1 | 5:L0 | 6:L0 | 7:L1 | 8:L1 | 9:L2 | 10:L1`
  2499 +- Top-20 Labels: `1:L2 | 2:L2 | 3:L1 | 4:L1 | 5:L0 | 6:L0 | 7:L1 | 8:L1 | 9:L2 | 10:L1 | 11:L1 | 12:L1 | 13:L2 | 14:L2 | 15:L2 | 16:L0 | 17:L0 | 18:L0 | 19:L1 | 20:L0`
  2500 +- Case Snapshot:
  2501 + - #1 [L2] spu=63255 KINGFEN Womens Shorts Casual Lounge Cotton Shorts for Summer Mid Rise Elastic Waist Linen Beach Pull On Comfy Drawstring Stretchy Short with Pockets Beige X-Large (rel=174.84747)
  2502 + zh: KINGFEN 女士夏季休闲棉质中腰弹性裤腰束脚沙滩裤 侧袋设计 透气舒适抽绳短裤 米色 大号
  2503 + - #2 [L2] spu=61246 Womens Drawstring Shorts Summer Elastic Waist Casual Lightweight with Pockets (rel=118.64401)
  2504 + zh: 女式抽绳短裤 夏季弹性腰身 休闲轻便带口袋
  2505 + - #3 [L1] spu=65041 APAFES Women Summer Cotton Linen Short Sets 2 Piece Shorts Top Lounge Beach Vacation Two Piece Outfits Tracksuits (rel=136.52039)
  2506 + zh: APAFES 女士夏季棉麻短款套装 两件套 短袖上衣休闲沙滩度假运动服 运动套装
  2507 + - #4 [L1] spu=67278 2025 Jean Shorts for Women Casual Stretchy Denim Summer Hot Short (rel=125.13113)
  2508 + zh: 2025年女士休闲弹力牛仔短裤 夏季爆款短裤
  2509 + - #5 [L0] spu=63262 maamgic Men's Classic-fit 5.5" Cotton Casual Shorts Elastic Waistband with Multi-Pocket Daily Wear Walking Summer Outfit (rel=104.03872)
  2510 + zh: maamgic 男款经典版型5.5英寸纯棉休闲短裤 弹力腰头多口袋 日常穿搭 夏季步行装
  2511 +
  2512 +### tall slim fit men's linen shirt
  2513 +
  2514 +- Primary_Metric_Score: 0.643492
  2515 +- NDCG@20: 0.829721
  2516 +- NDCG@50: 0.775585
  2517 +- ERR@10: 0.586176
  2518 +- Strong_Precision@10: 0.8
  2519 +- Strong_Precision@20: 0.6
  2520 +- Useful_Precision@50: 0.66
  2521 +- Avg_Grade@10: 1.7
  2522 +- Gain_Recall@20: 0.329787
  2523 +- ERR@10: 0.586176
  2524 +- ERR@20: 0.587633
  2525 +- ERR@5: 0.575348
  2526 +- ERR@50: 0.587685
  2527 +- Exact_Precision@10: 0.0
  2528 +- Exact_Precision@20: 0.0
  2529 +- Exact_Precision@5: 0.0
  2530 +- Exact_Success@10: 0.0
  2531 +- Exact_Success@5: 0.0
  2532 +- Gain_Recall@10: 0.180851
  2533 +- Gain_Recall@50: 0.531915
  2534 +- MRR_Exact@10: 0.0
  2535 +- MRR_Strong@10: 1.0
  2536 +- NDCG@10: 0.899697
  2537 +- NDCG@5: 1.0
  2538 +- Strong_Precision@5: 1.0
  2539 +- Strong_Success@10: 1.0
  2540 +- Strong_Success@5: 1.0
  2541 +- Useful_Precision@10: 0.9
  2542 +- Useful_Precision@20: 0.95
  2543 +- Fully Relevant: 0
  2544 +- Mostly Relevant: 17
  2545 +- Weakly Relevant: 28
  2546 +- Irrelevant: 55
  2547 +- Request ID: `ce7bc79f`
  2548 +- Top-10 Labels: `1:L2 | 2:L2 | 3:L2 | 4:L2 | 5:L2 | 6:L2 | 7:L1 | 8:L2 | 9:L2 | 10:L0`
  2549 +- Top-20 Labels: `1:L2 | 2:L2 | 3:L2 | 4:L2 | 5:L2 | 6:L2 | 7:L1 | 8:L2 | 9:L2 | 10:L0 | 11:L1 | 12:L2 | 13:L2 | 14:L1 | 15:L2 | 16:L1 | 17:L1 | 18:L1 | 19:L1 | 20:L2`
  2550 +- Case Snapshot:
  2551 + - #1 [L2] spu=66347 Faherty Men's Palma Basket Weave Linen Shirt (rel=220.56683)
  2552 + zh: Faherty 男款帕尔玛篮纹亚麻衬衫
  2553 + - #2 [L2] spu=64372 Button Down Linen Shirts for Men Casual Long Sleeve Regular Fit Cotton Beach Shirts with Pocket (rel=231.05592)
  2554 + zh: 男士休闲长袖棉质口袋衬衫
  2555 + - #3 [L2] spu=61150 Mens Casual Long Sleeve Cotton Linen Shirts Buttons Down Solid Plain Roll-Up Sleeve Summer Beach Shirts (rel=201.6317)
  2556 + zh: 男式休闲长袖纯棉亚麻衬衫 亨利领纯色卷袖 夏季沙滩衬衫
  2557 + - #4 [L2] spu=67098 Mens Casual Long Sleeve Cotton Linen Shirts Buttons Down Solid Plain Roll-Up Sleeve Summer Beach Shirts (rel=201.6317)
  2558 + zh: 男式休闲长袖纯棉亚麻衬衫 亨利领纯色卷袖 夏季沙滩衬衫
  2559 + - #5 [L2] spu=69414 Mens Casual Long Sleeve Cotton Linen Shirts Buttons Down Solid Plain Roll-Up Sleeve Summer Beach Shirts (rel=201.6317)
  2560 + zh: 男式休闲长袖纯棉亚麻衬衫 亨利领纯色卷袖 夏季沙滩衬衫
  2561 +
  2562 +### tall slim fit trousers
  2563 +
  2564 +- Primary_Metric_Score: 0.463524
  2565 +- NDCG@20: 0.569238
  2566 +- NDCG@50: 0.581315
  2567 +- ERR@10: 0.514827
  2568 +- Strong_Precision@10: 0.4
  2569 +- Strong_Precision@20: 0.4
  2570 +- Useful_Precision@50: 0.78
  2571 +- Avg_Grade@10: 1.2
  2572 +- Gain_Recall@20: 0.062814
  2573 +- ERR@10: 0.514827
  2574 +- ERR@20: 0.516222
  2575 +- ERR@5: 0.512126
  2576 +- ERR@50: 0.516237
  2577 +- Exact_Precision@10: 0.1
  2578 +- Exact_Precision@20: 0.1
  2579 +- Exact_Precision@5: 0.2
  2580 +- Exact_Success@10: 1.0
  2581 +- Exact_Success@5: 1.0
  2582 +- Gain_Recall@10: 0.030151
  2583 +- Gain_Recall@50: 0.153266
  2584 +- MRR_Exact@10: 0.2
  2585 +- MRR_Strong@10: 1.0
  2586 +- NDCG@10: 0.538504
  2587 +- NDCG@5: 0.600691
  2588 +- Strong_Precision@5: 0.6
  2589 +- Strong_Success@10: 1.0
  2590 +- Strong_Success@5: 1.0
  2591 +- Useful_Precision@10: 0.7
  2592 +- Useful_Precision@20: 0.75
  2593 +- Fully Relevant: 2
  2594 +- Mostly Relevant: 24
  2595 +- Weakly Relevant: 44
  2596 +- Irrelevant: 30
  2597 +- Request ID: `1a0eefd6`
  2598 +- Top-10 Labels: `1:L2 | 2:L0 | 3:L1 | 4:L2 | 5:L3 | 6:L1 | 7:L0 | 8:L1 | 9:L0 | 10:L2`
  2599 +- Top-20 Labels: `1:L2 | 2:L0 | 3:L1 | 4:L2 | 5:L3 | 6:L1 | 7:L0 | 8:L1 | 9:L0 | 10:L2 | 11:L0 | 12:L2 | 13:L1 | 14:L0 | 15:L1 | 16:L2 | 17:L2 | 18:L1 | 19:L1 | 20:L3`
  2600 +- Case Snapshot:
  2601 + - #1 [L2] spu=62720 Haggar Men's Premium No Iron Khaki Classic Fit Flat Front Casual Pant (Regular and Big & Tall Sizes) (rel=121.27456)
  2602 + zh: Haggar 男士优质免烫卡其色经典版型直筒休闲裤（常规及加大尺码）
  2603 + - #2 [L0] spu=65698 Women's Dress Pants Business Casual Stretchy Work Pants High Waisted Pull On Slacks Office Wide Leg Trousers Light Grey (rel=133.08923)
  2604 + zh: 女式商务休闲弹力高腰直筒办公长裤 浅灰色
  2605 + - #3 [L1] spu=68630 New Amazon Aliexpress Cross-Border European and American Women's Jeans Women's High-Waisted Slim Straight Denim Trousers (rel=166.84497)
  2606 + zh: 全新亚马逊速卖通跨境欧美女式牛仔裤 女式高腰修身直筒牛仔裤
  2607 + - #4 [L2] spu=68619 2025 New Fashion European and American Women's Jeans High-Waisted Slim Straight Denim Pants Popular Floor-Length Pants (rel=121.89264)
  2608 + zh: 2025新款欧美风女式高腰显瘦直筒牛仔裤 时尚及地长裤
  2609 + - #5 [L3] spu=60816 Agenlulu High Waisted Dress Pants for Women Petite/Regular/Tall Bootcut Pull On Yoga Work Slacks Pockets 28"/29.5"/31.5" (rel=113.34048)
  2610 + zh: Agenlulu 女士高腰裤装 修身/常规/高个子款 裤脚微喇 弹力套头瑜伽工作长裤 带口袋 可选28英寸/29.5英寸/31.5英寸
  2611 +
  2612 +### tall straight leg pants
  2613 +
  2614 +- Primary_Metric_Score: 0.671879
  2615 +- NDCG@20: 0.683096
  2616 +- NDCG@50: 0.773123
  2617 +- ERR@10: 0.673202
  2618 +- Strong_Precision@10: 0.9
  2619 +- Strong_Precision@20: 0.65
  2620 +- Useful_Precision@50: 0.9
  2621 +- Avg_Grade@10: 2.2
  2622 +- Gain_Recall@20: 0.062278
  2623 +- ERR@10: 0.673202
  2624 +- ERR@20: 0.673209
  2625 +- ERR@5: 0.672597
  2626 +- ERR@50: 0.673209
  2627 +- Exact_Precision@10: 0.3
  2628 +- Exact_Precision@20: 0.2
  2629 +- Exact_Precision@5: 0.4
  2630 +- Exact_Success@10: 1.0
  2631 +- Exact_Success@5: 1.0
  2632 +- Gain_Recall@10: 0.039146
  2633 +- Gain_Recall@50: 0.160142
  2634 +- MRR_Exact@10: 0.5
  2635 +- MRR_Strong@10: 1.0
  2636 +- NDCG@10: 0.754562
  2637 +- NDCG@5: 0.794522
  2638 +- Strong_Precision@5: 1.0
  2639 +- Strong_Success@10: 1.0
  2640 +- Strong_Success@5: 1.0
  2641 +- Useful_Precision@10: 1.0
  2642 +- Useful_Precision@20: 0.9
  2643 +- Fully Relevant: 9
  2644 +- Mostly Relevant: 49
  2645 +- Weakly Relevant: 12
  2646 +- Irrelevant: 30
  2647 +- Request ID: `34a33321`
  2648 +- Top-10 Labels: `1:L2 | 2:L3 | 3:L3 | 4:L2 | 5:L2 | 6:L3 | 7:L2 | 8:L2 | 9:L2 | 10:L1`
  2649 +- Top-20 Labels: `1:L2 | 2:L3 | 3:L3 | 4:L2 | 5:L2 | 6:L3 | 7:L2 | 8:L2 | 9:L2 | 10:L1 | 11:L1 | 12:L1 | 13:L0 | 14:L0 | 15:L1 | 16:L3 | 17:L2 | 18:L1 | 19:L2 | 20:L2`
  2650 +- Case Snapshot:
  2651 + - #1 [L2] spu=60727 HDE Women's Faux Leather Pants High Waisted Straight Leg Trousers with Pockets (rel=259.08588)
  2652 + zh: HDE 女士仿皮高腰直筒裤带口袋
  2653 + - #2 [L3] spu=62082 Lee Womens Ultra Lux Comfort Any Wear Straight Leg Pant (rel=238.44328)
  2654 + zh: 李女士超舒适百搭直筒裤
  2655 + - #3 [L3] spu=62029 iChosy Women's Stretchy Straight Leg Dress Work Pants Business Office Casual Slacks with Pockets (rel=211.21452)
  2656 + zh: iChosy 女士弹力直筒办公裤 商务休闲裤 带口袋
  2657 + - #4 [L2] spu=67020 Same Style as Alogant Woven Straight-Leg Wide-Leg Pants, Casual Drapey Elastic Waistband, Loose Fit for Women, Sports Style, Makes Legs Look Longer (rel=187.04218)
  2658 + zh: Alogant 风格编织直筒阔腿裤，休闲垂感弹力腰头，宽松版型女式运动风，视觉拉长腿部线条
  2659 + - #5 [L2] spu=62077 G4Free EverGoing Yoga Pants Women Wide Leg Pants with Pockets High Waist Stretch Dress Casual Sweatpants Petite/Regular/Tall (rel=157.32184)
  2660 + zh: G4Free 永恒前行瑜伽裤 女士宽腿带袋高腰弹力连衣裤 休闲运动裤 适合娇小/常规/高个型号
  2661 +
  2662 +### tassel maxi skirt
  2663 +
  2664 +- Primary_Metric_Score: 0.696889
  2665 +- NDCG@20: 0.831544
  2666 +- NDCG@50: 0.767353
  2667 +- ERR@10: 0.587764
  2668 +- Strong_Precision@10: 1.0
  2669 +- Strong_Precision@20: 0.75
  2670 +- Useful_Precision@50: 0.84
  2671 +- Avg_Grade@10: 2.0
  2672 +- Gain_Recall@20: 0.131783
  2673 +- ERR@10: 0.587764
  2674 +- ERR@20: 0.588392
  2675 +- ERR@5: 0.575348
  2676 +- ERR@50: 0.588415
  2677 +- Exact_Precision@10: 0.0
  2678 +- Exact_Precision@20: 0.0
  2679 +- Exact_Precision@5: 0.0
  2680 +- Exact_Success@10: 0.0
  2681 +- Exact_Success@5: 0.0
  2682 +- Gain_Recall@10: 0.077519
  2683 +- Gain_Recall@50: 0.290698
  2684 +- MRR_Exact@10: 0.0
  2685 +- MRR_Strong@10: 1.0
  2686 +- NDCG@10: 0.900864
  2687 +- NDCG@5: 0.855008
  2688 +- Strong_Precision@5: 1.0
  2689 +- Strong_Success@10: 1.0
  2690 +- Strong_Success@5: 1.0
  2691 +- Useful_Precision@10: 1.0
  2692 +- Useful_Precision@20: 0.95
  2693 +- Fully Relevant: 1
  2694 +- Mostly Relevant: 49
  2695 +- Weakly Relevant: 19
  2696 +- Irrelevant: 31
  2697 +- Request ID: `9d2881b1`
  2698 +- Top-10 Labels: `1:L2 | 2:L2 | 3:L2 | 4:L2 | 5:L2 | 6:L2 | 7:L2 | 8:L2 | 9:L2 | 10:L2`
  2699 +- Top-20 Labels: `1:L2 | 2:L2 | 3:L2 | 4:L2 | 5:L2 | 6:L2 | 7:L2 | 8:L2 | 9:L2 | 10:L2 | 11:L0 | 12:L2 | 13:L1 | 14:L2 | 15:L2 | 16:L1 | 17:L1 | 18:L1 | 19:L2 | 20:L2`
  2700 +- Case Snapshot:
  2701 + - #1 [L2] spu=62007 Yincro Women's Flowy Maxi Skirt Summer Pleated High Waisted Casual Long Skirts with Pockets (rel=84.032196)
  2702 + zh: Yincro 女士夏季褶皱高腰休闲长款带口袋阔摆长裙
  2703 + - #2 [L2] spu=64945 Maxi Skirts for Women with Pockets Long Midi Length Casual Skirt for Beach Party Holiday (rel=86.3725)
  2704 + zh: 女士带口袋长款中长裙 休闲沙滩派对假日裙
  2705 + - #3 [L2] spu=66254 Sweet Hearts Maxi Skirts for Women with Pockets- Elastic Waist Casual Long Skirts XS-XL Made in USA (rel=83.67037)
  2706 + zh: 女士爱心图案大号长裙带口袋 - 弹性腰身休闲长裙，XS-XL，美国制造
  2707 + - #4 [L2] spu=61346 HAEOF Womens Summer Flowy Boho Maxi Skirt Elastic High Waist A Line Pleated Tiered Trendy Beach Long Skirts with Pockets (rel=80.41771)
  2708 + zh: HAEOF 女士夏季飘逸波西米亚长裙 高腰弹力A字褶皱分层时尚沙滩长裙带口袋
  2709 + - #5 [L2] spu=61568 CFLONGE Summer Maxi Skirts for Women 2025 Fashion Boho Long Skirt Trendy Floral High Waist A Line Beach Skirt Vacation Outfit (rel=83.126396)
  2710 + zh: CFLONGE 2025 夏季女装时尚波西米亚长裙 高腰A字印花沙滩裙 旅行穿搭
  2711 +
  2712 +### teacher clothes
  2713 +
  2714 +- Primary_Metric_Score: 0.396811
  2715 +- NDCG@20: 0.395051
  2716 +- NDCG@50: 0.381644
  2717 +- ERR@10: 0.308837
  2718 +- Strong_Precision@10: 0.5
  2719 +- Strong_Precision@20: 0.45
  2720 +- Useful_Precision@50: 0.66
  2721 +- Avg_Grade@10: 1.4
  2722 +- Gain_Recall@20: 0.012289
  2723 +- ERR@10: 0.308837
  2724 +- ERR@20: 0.31278
  2725 +- ERR@5: 0.232524
  2726 +- ERR@50: 0.313021
  2727 +- Exact_Precision@10: 0.0
  2728 +- Exact_Precision@20: 0.0
  2729 +- Exact_Precision@5: 0.0
  2730 +- Exact_Success@10: 0.0
  2731 +- Exact_Success@5: 0.0
  2732 +- Gain_Recall@10: 0.007168
  2733 +- Gain_Recall@50: 0.026626
  2734 +- MRR_Exact@10: 0.0
  2735 +- MRR_Strong@10: 0.166667
  2736 +- NDCG@10: 0.421975
  2737 +- NDCG@5: 0.289598
  2738 +- Strong_Precision@5: 0.0
  2739 +- Strong_Success@10: 1.0
  2740 +- Strong_Success@5: 0.0
  2741 +- Useful_Precision@10: 0.9
  2742 +- Useful_Precision@20: 0.75
  2743 +- Fully Relevant: 0
  2744 +- Mostly Relevant: 28
  2745 +- Weakly Relevant: 29
  2746 +- Irrelevant: 43
  2747 +- Request ID: `1272ac7f`
  2748 +- Top-10 Labels: `1:L1 | 2:L1 | 3:L1 | 4:L1 | 5:L0 | 6:L2 | 7:L2 | 8:L2 | 9:L2 | 10:L2`
  2749 +- Top-20 Labels: `1:L1 | 2:L1 | 3:L1 | 4:L1 | 5:L0 | 6:L2 | 7:L2 | 8:L2 | 9:L2 | 10:L2 | 11:L2 | 12:L1 | 13:L1 | 14:L2 | 15:L2 | 16:L2 | 17:L0 | 18:L0 | 19:L0 | 20:L0`
  2750 +- Case Snapshot:
  2751 + - #1 [L1] spu=64591 MAIHUN Women Teacher Life Shirt Teacher Gift Short Sleeve Shirts It s a Beautiful Day for Learning T-Shirt (rel=170.08438)
  2752 + zh: MAIHUN 女士教师生活短袖T恤 教师节礼物 今天是学习的美好一天 迷人印花T恤
  2753 + - #2 [L1] spu=60584 Teach T Shirt for Women Teacher Graphic Tees Tops Teach Inspire Letter Print Shirts Tops (rel=153.68323)
  2754 + zh: 女教师教学励志字母印花T恤上衣
  2755 + - #3 [L1] spu=62602 LUKYCILD Teacher Shirt Women First Day of School Shirts Progress Over Perfection Tee Casual Teacher Life Short Sleeve T-Shirt (rel=167.65187)
  2756 + zh: LUKYCILD 女士教师衫 学校开学第一天衬衫 进步胜过完美休闲教师生活短袖T恤
  2757 + - #4 [L1] spu=64853 Women Teach Them Love Them Watch Them Grow Wildflower Teacher Shirts Summer Inspirational Teaching Halloween Graphic Tees (rel=152.45625)
  2758 + zh: 教师节爱他们，看他们成长——野花教师夏装励志万圣节印花T恤
  2759 + - #5 [L0] spu=66308 UAREHIBY Teacher Appreciation Gifts,Best Teacher Gifts for Women,Back to School Thank You Gift for Teachers from Students,Teachers Valentine Christmas Gift (rel=160.76584)
  2760 + zh: UAREHIBY 教师节感恩礼物，送给女性教师的最佳礼物，学生返校感谢老师礼品，教师情人节圣诞礼物
... ...
benchmarks/perf_api_benchmark.py
  Show/Hide comments   View file @d6c2973
... ... @@ -181,6 +181,32 @@ def make_default_templates(tenant_id: str) -> Dict[str, List[RequestTemplate]]:
181 181 json_body={"text": "Product title", "target_lang": "zh", "model": "qwen"},
182 182 ),
183 183 ],
  184 + # DeepL-focused translation latency cases (single + batch).
  185 + # These cases are safe defaults; require DEEPL_AUTH_KEY and deepl capability enabled.
  186 + "translate_deepl": [
  187 + RequestTemplate(
  188 + method="POST",
  189 + path="/translate",
  190 + json_body={
  191 + "text": "商品名称",
  192 + "target_lang": "en",
  193 + "source_lang": "zh",
  194 + "model": "deepl",
  195 + "scene": "ecommerce_search_query",
  196 + },
  197 + ),
  198 + RequestTemplate(
  199 + method="POST",
  200 + path="/translate",
  201 + json_body={
  202 + "text": ["商品名称", "商品标题", "颜色", "尺码", "材质", "适用人群"],
  203 + "target_lang": "en",
  204 + "source_lang": "zh",
  205 + "model": "deepl",
  206 + "scene": "ecommerce_search_query",
  207 + },
  208 + ),
  209 + ],
184 210 "rerank": [
185 211 RequestTemplate(
186 212 method="POST",
... ... @@ -271,6 +297,7 @@ def build_scenarios(args: argparse.Namespace) -> Dict[str, Scenario]:
271 297 "embed_text": args.embedding_text_base,
272 298 "embed_image": args.embedding_image_base,
273 299 "translate": args.translator_base,
  300 + "translate_deepl": args.translator_base,
274 301 "rerank": args.reranker_base,
275 302 }
276 303  
... ... @@ -487,7 +514,7 @@ def parse_args() -> argparse.Namespace:
487 514 "--scenario",
488 515 type=str,
489 516 default="all",
490   - help="Scenario: backend_search | backend_suggest | embed_text | embed_image | translate | rerank | all | comma-separated list",
  517 + help="Scenario: backend_search | backend_suggest | embed_text | embed_image | translate | translate_deepl | rerank | all | comma-separated list",
491 518 )
492 519 parser.add_argument("--tenant-id", type=str, default="162", help="Tenant ID for backend search/suggest")
493 520 parser.add_argument("--duration", type=int, default=30, help="Duration seconds per scenario; <=0 means no duration cap")
... ... @@ -614,7 +641,7 @@ async def main_async() -&gt; int:
614 641 args = parse_args()
615 642 scenarios = build_scenarios(args)
616 643  
617   - all_names = ["backend_search", "backend_suggest", "embed_text", "embed_image", "translate", "rerank"]
  644 + all_names = ["backend_search", "backend_suggest", "embed_text", "embed_image", "translate", "translate_deepl", "rerank"]
618 645 if args.scenario == "all":
619 646 run_names = [x for x in all_names if x in scenarios]
620 647 else:
... ...
config/config.yaml
  Show/Hide comments   View file @d6c2973
... ... @@ -124,9 +124,9 @@ query_config:
124 124 enable_text_embedding: true
125 125 enable_query_rewrite: true
126 126  
127   - zh_to_en_model: deepl # nllb-200-distilled-600m
128   - en_to_zh_model: deepl
129   - default_translation_model: deepl
  127 + zh_to_en_model: nllb-200-distilled-600m # nllb-200-distilled-600m deepl opus-mt-zh-en / opus-mt-en-zh
  128 + en_to_zh_model: nllb-200-distilled-600m
  129 + default_translation_model: nllb-200-distilled-600m
130 130 # 源语种不在 index_languages时翻译质量比较重要，因此单独配置
131 131 zh_to_en_model__source_not_in_index: deepl
132 132 en_to_zh_model__source_not_in_index: deepl
... ... @@ -374,14 +374,14 @@ services:
374 374 ct2_max_queued_batches: 32
375 375 ct2_batch_type: examples
376 376 ct2_decoding_length_mode: source
377   - ct2_decoding_length_extra: 8
  377 + ct2_decoding_length_extra: 16
378 378 ct2_decoding_length_min: 32
379 379 device: cuda
380 380 torch_dtype: float16
381 381 batch_size: 64
382 382 max_input_length: 256
383   - max_new_tokens: 64
384   - num_beams: 1
  383 + max_new_tokens: 96
  384 + num_beams: 4
385 385 use_cache: true
386 386 opus-mt-zh-en:
387 387 enabled: false
... ...
docs/搜索API对接指南-07-微服务接口（Embedding-Reranker-Translation）.md
  Show/Hide comments   View file @d6c2973
... ... @@ -287,9 +287,8 @@ curl &quot;http://localhost:6007/health&quot;
287 287 - 如果是en-zh互译、期待更高的速度，可以考虑`opus-mt-zh-en` / `opus-mt-en-zh`。（质量未详细评测，一些文章说比blib-200-600m更好，但是我看了些case感觉要差不少）
288 288  
289 289 **实时翻译选型建议**:
290   -- 在线 query 翻译如果只是 `en/zh` 互译，优先使用 `opus-mt-zh-en` 或 `opus-mt-en-zh`。
  290 +- 在线 query 翻译如果只是 `en/zh` 互译，极致要求耗时使用 `opus-mt-zh-en / opus-mt-en-zh`，`nllb-200-distilled-600m`支持多语言，效果略好一点，但是耗时长很多（70-150ms之间）
291 291 - 如果涉及其他语言，或对质量要求高于本地轻量模型，优先考虑 `deepl`。
292   -- `nllb-200-distilled-600m` 不建议作为在线 query 翻译默认方案；我们在 `Tesla T4` 上测到 `batch_size=1` 时，根据query长短，耗时大概在70-150ms之间。
293 292  
294 293 **Batch Size / 调用方式建议**:
295 294 - 本接口支持 `text: string[]`；离线或批量索引翻译时，应尽量合并请求，让底层 backend 发挥批处理能力。
... ...
tests/test_translation_deepl_backend.py 0 → 100644
  Show/Hide comments   View file @d6c2973
... ... @@ -0,0 +1,92 @@
  1 +from translation.backends.deepl import DeepLTranslationBackend
  2 +
  3 +
  4 +class _FakeResponse:
  5 + def __init__(self, status_code, payload=None, text=""):
  6 + self.status_code = status_code
  7 + self._payload = payload or {}
  8 + self.text = text
  9 +
  10 + def json(self):
  11 + return self._payload
  12 +
  13 +
  14 +class _FakeSession:
  15 + def __init__(self, responses):
  16 + self.responses = list(responses)
  17 + self.calls = []
  18 +
  19 + def post(self, url, *, headers, json, timeout):
  20 + self.calls.append(
  21 + {
  22 + "url": url,
  23 + "headers": headers,
  24 + "json": json,
  25 + "timeout": timeout,
  26 + }
  27 + )
  28 + response = self.responses.pop(0)
  29 + if isinstance(response, Exception):
  30 + raise response
  31 + return response
  32 +
  33 +
  34 +def test_deepl_translate_uses_persistent_session_and_connect_timeout():
  35 + backend = DeepLTranslationBackend(
  36 + api_key="test-key",
  37 + api_url="https://api.deepl.com/v2/translate",
  38 + timeout=5.0,
  39 + glossary_id="glossary-1",
  40 + )
  41 + fake_session = _FakeSession(
  42 + [
  43 + _FakeResponse(
  44 + 200,
  45 + payload={"translations": [{"text": "Product title"}]},
  46 + )
  47 + ]
  48 + )
  49 + backend._session = fake_session
  50 +
  51 + result = backend.translate(
  52 + "商品标题",
  53 + target_lang="en",
  54 + source_lang="zh",
  55 + scene="ecommerce_search_query",
  56 + )
  57 +
  58 + assert result == "Product title"
  59 + assert len(fake_session.calls) == 1
  60 + call = fake_session.calls[0]
  61 + assert call["timeout"] == (2.0, 5.0)
  62 + assert call["json"]["target_lang"] == "EN"
  63 + assert call["json"]["source_lang"] == "ZH"
  64 + assert call["json"]["glossary_id"] == "glossary-1"
  65 + assert call["json"]["context"]
  66 +
  67 +
  68 +def test_deepl_translate_retries_retryable_failures(monkeypatch):
  69 + monkeypatch.setattr("translation.backends.deepl.time.sleep", lambda *_args, **_kwargs: None)
  70 +
  71 + backend = DeepLTranslationBackend(
  72 + api_key="test-key",
  73 + api_url="https://api.deepl.com/v2/translate",
  74 + timeout=5.0,
  75 + )
  76 + fake_session = _FakeSession(
  77 + [
  78 + _FakeResponse(429, text="too many requests"),
  79 + _FakeResponse(200, payload={"translations": [{"text": "dress"}]}),
  80 + ]
  81 + )
  82 + backend._session = fake_session
  83 +
  84 + result = backend.translate(
  85 + "连衣裙",
  86 + target_lang="en",
  87 + source_lang="zh",
  88 + scene="general",
  89 + )
  90 +
  91 + assert result == "dress"
  92 + assert len(fake_session.calls) == 2
... ...
translation/backends/deepl.py
  Show/Hide comments   View file @d6c2973
... ... @@ -4,9 +4,11 @@ from __future__ import annotations
4 4  
5 5 import logging
6 6 import re
  7 +import time
7 8 from typing import List, Optional, Sequence, Tuple, Union
8 9  
9 10 import requests
  11 +from requests.adapters import HTTPAdapter
10 12  
11 13 from translation.languages import DEEPL_LANGUAGE_CODES
12 14 from translation.scenes import SCENE_DEEPL_CONTEXTS, normalize_scene_name
... ... @@ -15,6 +17,10 @@ logger = logging.getLogger(__name__)
15 17  
16 18  
17 19 class DeepLTranslationBackend:
  20 + _CONNECT_TIMEOUT_SEC = 2.0
  21 + _MAX_RETRIES = 2
  22 + _RETRYABLE_STATUS_CODES = {429, 500, 502, 503, 504}
  23 +
18 24 def __init__(
19 25 self,
20 26 api_key: Optional[str],
... ... @@ -28,6 +34,9 @@ class DeepLTranslationBackend:
28 34 self.timeout = float(timeout)
29 35 self.glossary_id = glossary_id
30 36 self.model = "deepl"
  37 + self._session = requests.Session()
  38 + self._session.mount("http://", HTTPAdapter(pool_connections=32, pool_maxsize=32, max_retries=0))
  39 + self._session.mount("https://", HTTPAdapter(pool_connections=32, pool_maxsize=32, max_retries=0))
31 40 if not self.api_key:
32 41 logger.warning("DEEPL_AUTH_KEY not set; DeepL translation is unavailable")
33 42  
... ... @@ -47,6 +56,68 @@ class DeepLTranslationBackend:
47 56 tgt = str(target_lang or "").strip().lower()
48 57 return scene_map.get(tgt) or scene_map.get("en")
49 58  
  59 + def _build_headers(self) -> dict:
  60 + return {
  61 + "Authorization": f"DeepL-Auth-Key {self.api_key}",
  62 + "Content-Type": "application/json",
  63 + }
  64 +
  65 + def _build_payload(
  66 + self,
  67 + *,
  68 + texts: List[str],
  69 + target_code: str,
  70 + source_lang: Optional[str],
  71 + api_context: Optional[str],
  72 + ) -> dict:
  73 + payload: dict = {"text": texts, "target_lang": target_code}
  74 + if source_lang:
  75 + payload["source_lang"] = DEEPL_LANGUAGE_CODES.get(source_lang.lower(), source_lang.upper())
  76 + if api_context:
  77 + payload["context"] = api_context
  78 + if self.glossary_id:
  79 + payload["glossary_id"] = self.glossary_id
  80 + return payload
  81 +
  82 + def _post_with_retries(self, *, headers: dict, payload: dict, target_code: str) -> Optional[dict]:
  83 + for attempt in range(self._MAX_RETRIES + 1):
  84 + try:
  85 + response = self._session.post(
  86 + self.api_url,
  87 + headers=headers,
  88 + json=payload,
  89 + timeout=(self._CONNECT_TIMEOUT_SEC, self.timeout),
  90 + )
  91 + except requests.Timeout:
  92 + logger.warning("[deepl] Timeout | tgt=%s timeout=%.1fs", target_code, self.timeout)
  93 + return None
  94 + except Exception as exc:
  95 + logger.warning("[deepl] Exception | tgt=%s error=%s", target_code, exc, exc_info=True)
  96 + return None
  97 +
  98 + if response.status_code == 200:
  99 + try:
  100 + return response.json()
  101 + except Exception as exc:
  102 + logger.warning("[deepl] Bad JSON | tgt=%s error=%s body=%s", target_code, exc, (response.text or "")[:200])
  103 + return None
  104 +
  105 + retryable = response.status_code in self._RETRYABLE_STATUS_CODES
  106 + logger.warning(
  107 + "[deepl] Failed | status=%s tgt=%s attempt=%s/%s body=%s",
  108 + response.status_code,
  109 + target_code,
  110 + attempt + 1,
  111 + self._MAX_RETRIES + 1,
  112 + (response.text or "")[:200],
  113 + )
  114 + if (not retryable) or attempt >= self._MAX_RETRIES:
  115 + return None
  116 + sleep_s = min(1.0, 0.1 * (2 ** attempt))
  117 + time.sleep(sleep_s)
  118 +
  119 + return None
  120 +
50 121 def translate(
51 122 self,
52 123 text: Union[str, Sequence[str]],
... ... @@ -73,52 +144,27 @@ class DeepLTranslationBackend:
73 144 return None
74 145  
75 146 target_code = DEEPL_LANGUAGE_CODES.get((target_lang or "").lower(), (target_lang or "").upper())
76   - headers = {
77   - "Authorization": f"DeepL-Auth-Key {self.api_key}",
78   - "Content-Type": "application/json",
79   - }
80   -
81 147 api_context = self._resolve_request_context(target_lang, scene)
82   - text_to_translate, needs_extraction = self._add_ecommerce_context(text, source_lang, api_context)
83   -
84   - payload = {
85   - "text": [text_to_translate],
86   - "target_lang": target_code,
87   - }
88   - if source_lang:
89   - payload["source_lang"] = DEEPL_LANGUAGE_CODES.get(source_lang.lower(), source_lang.upper())
90   - if api_context:
91   - payload["context"] = api_context
92   - if self.glossary_id:
93   - payload["glossary_id"] = self.glossary_id
94   -
95   - try:
96   - response = requests.post(self.api_url, headers=headers, json=payload, timeout=self.timeout)
97   - if response.status_code != 200:
98   - logger.warning(
99   - "[deepl] Failed | status=%s tgt=%s body=%s",
100   - response.status_code,
101   - target_code,
102   - (response.text or "")[:200],
103   - )
104   - return None
105   -
106   - data = response.json()
107   - translations = data.get("translations") or []
108   - if not translations:
109   - return None
110   - translated = translations[0].get("text")
111   - if not translated:
112   - return None
113   - if needs_extraction:
114   - translated = self._extract_term_from_translation(translated, text, target_code)
115   - return translated
116   - except requests.Timeout:
117   - logger.warning("[deepl] Timeout | tgt=%s timeout=%.1fs", target_code, self.timeout)
  148 + headers = self._build_headers()
  149 +
  150 + text_to_translate, needs_extraction = self._add_ecommerce_context(str(text), source_lang, api_context)
  151 +
  152 + payload = self._build_payload(
  153 + texts=[text_to_translate],
  154 + target_code=target_code,
  155 + source_lang=source_lang,
  156 + api_context=api_context,
  157 + )
  158 + data = self._post_with_retries(headers=headers, payload=payload, target_code=target_code)
  159 + translations = (data or {}).get("translations") or []
  160 + if not translations:
118 161 return None
119   - except Exception as exc:
120   - logger.warning("[deepl] Exception | tgt=%s error=%s", target_code, exc, exc_info=True)
  162 + translated = translations[0].get("text") if isinstance(translations[0], dict) else None
  163 + if not translated:
121 164 return None
  165 + if needs_extraction:
  166 + translated = self._extract_term_from_translation(translated, text, target_code)
  167 + return translated
122 168  
123 169 def _add_ecommerce_context(
124 170 self,
... ...
translation/client.py
  Show/Hide comments   View file @d6c2973
... ... @@ -6,6 +6,7 @@ import logging
6 6 from typing import List, Optional, Sequence, Union
7 7  
8 8 import requests
  9 +from requests.adapters import HTTPAdapter
9 10  
10 11 from config.loader import get_app_config
11 12 from translation.settings import normalize_translation_model, normalize_translation_scene
... ... @@ -29,6 +30,9 @@ class TranslationServiceClient:
29 30 self.default_model = normalize_translation_model(cfg, default_model or cfg["default_model"])
30 31 self.default_scene = normalize_translation_scene(cfg, default_scene or cfg["default_scene"])
31 32 self.timeout_sec = float(cfg["timeout_sec"] if timeout_sec is None else timeout_sec)
  33 + self._session = requests.Session()
  34 + self._session.mount("http://", HTTPAdapter(pool_connections=32, pool_maxsize=32, max_retries=0))
  35 + self._session.mount("https://", HTTPAdapter(pool_connections=32, pool_maxsize=32, max_retries=0))
32 36  
33 37 @property
34 38 def model(self) -> str:
... ... @@ -56,10 +60,10 @@ class TranslationServiceClient:
56 60 "scene": self.default_scene if scene is None else scene,
57 61 }
58 62 try:
59   - response = requests.post(
  63 + response = self._session.post(
60 64 f"{self.base_url}/translate",
61 65 json=payload,
62   - timeout=self.timeout_sec,
  66 + timeout=(2.0, self.timeout_sec),
63 67 )
64 68 if response.status_code != 200:
65 69 logger.warning(
... ...