Skip to content
This repository was archived by the owner on Jan 26, 2022. It is now read-only.

Commit ab028df

Browse files
committed
Add benchmark results for mask-rcnn and keypoint-rcnn
1 parent 4cef36e commit ab028df

File tree

1 file changed

+59
-0
lines changed

1 file changed

+59
-0
lines changed

BENCHMARK.md

Lines changed: 59 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -5,6 +5,7 @@
55
- Benchmark results using the weights from [Detectron model zoo]() are basically the same. Hence, I won't list them here.
66
- All the testing results below are on COCO2017 val-set, using the models trained from scratch on COCO2017 train-set.
77
- Evaluation scores are rounded to 3 decimal places and presented in the format of percentage.
8+
- Multiple evaluation on using pytorch may be listed. Each represents different training trial with same settings.
89

910
### COCO evaluation metrics
1011

@@ -136,6 +137,21 @@
136137
<td align="right" bgcolor=white>64.9</td>
137138
</tr>
138139
<tr>
140+
<th bgcolor=white>PyTorch</th>
141+
<td align="right" bgcolor=white>37.6</td>
142+
<td align="right" bgcolor=white>59.1</td>
143+
<td align="right" bgcolor=white>40.9</td>
144+
<td align="right" bgcolor=white>21.6</td>
145+
<td align="right" bgcolor=white>40.7</td>
146+
<td align="right" bgcolor=white>49.0</td>
147+
<td align="right" bgcolor=white>31.2</td>
148+
<td align="right" bgcolor=white>49.0</td>
149+
<td align="right" bgcolor=white>51.4</td>
150+
<td align="right" bgcolor=white>32.3</td>
151+
<td align="right" bgcolor=white>55.0</td>
152+
<td align="right" bgcolor=white>64.7</td>
153+
</tr>
154+
<tr>
139155
<th bgcolor=white>Detectron</th>
140156
<td align="right" bgcolor=white>37.7</td>
141157
<td align="right" bgcolor=white>59.2</td>
@@ -185,6 +201,21 @@
185201
<td align="right" bgcolor=white>62.2</td>
186202
</tr>
187203
<tr>
204+
<th bgcolor=white>PyTorch</th>
205+
<td align="right" bgcolor=white>33.8</td>
206+
<td align="right" bgcolor=white>55.7</td>
207+
<td align="right" bgcolor=white>35.5</td>
208+
<td align="right" bgcolor=white>15.3</td>
209+
<td align="right" bgcolor=white>36.3</td>
210+
<td align="right" bgcolor=white>50.5</td>
211+
<td align="right" bgcolor=white>29.2</td>
212+
<td align="right" bgcolor=white>44.5</td>
213+
<td align="right" bgcolor=white>46.4</td>
214+
<td align="right" bgcolor=white>26.2</td>
215+
<td align="right" bgcolor=white>50.0</td>
216+
<td align="right" bgcolor=white>62.5</td>
217+
</tr>
218+
<tr>
188219
<th bgcolor=white>Detectron</th>
189220
<td align="right" bgcolor=white>33.9</td>
190221
<td align="right" bgcolor=white>55.8</td>
@@ -249,6 +280,21 @@
249280
<td align="right" bgcolor=white>75.9</td>
250281
</tr>
251282
<tr>
283+
<th bgcolor=white>PyTorch</th>
284+
<td align="right" bgcolor=white>53.5</td>
285+
<td align="right" bgcolor=white>82.8</td>
286+
<td align="right" bgcolor=white>58.4</td>
287+
<td align="right" bgcolor=white>36.7</td>
288+
<td align="right" bgcolor=white>61.2</td>
289+
<td align="right" bgcolor=white>69.5</td>
290+
<td align="right" bgcolor=white>18.6</td>
291+
<td align="right" bgcolor=white>54.2</td>
292+
<td align="right" bgcolor=white>62.2</td>
293+
<td align="right" bgcolor=white>47.8</td>
294+
<td align="right" bgcolor=white>68.3</td>
295+
<td align="right" bgcolor=white>76.7</td>
296+
</tr>
297+
<tr>
252298
<th bgcolor=white>Detectron</th>
253299
<td align="right" bgcolor=white>53.6</td>
254300
<td align="right" bgcolor=white>82.8</td>
@@ -294,6 +340,19 @@
294340
<td align="right" bgcolor=white>78.1</td>
295341
</tr>
296342
<tr>
343+
<th bgcolor=white>PyTorch</th>
344+
<td align="right" bgcolor=white>63.9</td>
345+
<td align="right" bgcolor=white>86.0</td>
346+
<td align="right" bgcolor=white>69.2</td>
347+
<td align="right" bgcolor=white>58.5</td>
348+
<td align="right" bgcolor=white>72.7</td>
349+
<td align="right" bgcolor=white>70.6</td>
350+
<td align="right" bgcolor=white>90.7</td>
351+
<td align="right" bgcolor=white>75.8</td>
352+
<td align="right" bgcolor=white>65.0</td>
353+
<td align="right" bgcolor=white>78.6</td>
354+
</tr>
355+
<tr>
297356
<th bgcolor=white>Detectron</th>
298357
<td align="right" bgcolor=white>64.2</td>
299358
<td align="right" bgcolor=white>86.4</td>

0 commit comments

Comments
 (0)