# Basic Operations Test Results

## Highscores

### Performance Rankings (Duration)

| Test | Model | Duration (ms) | Duration (s) |
|------|-------|--------------|--------------|
| addition | openai/gpt-4o-mini | 726 | 0.73 |
| addition | openrouter/quasar-alpha | 814 | 0.81 |
| addition | openai/gpt-3.5-turbo | 1157 | 1.16 |
| addition | deepseek/deepseek-r1-distill-qwen-14b:free | 4214 | 4.21 |
| multiplication | openrouter/quasar-alpha | 684 | 0.68 |
| multiplication | openai/gpt-3.5-turbo | 826 | 0.83 |
| multiplication | openai/gpt-4o-mini | 856 | 0.86 |
| multiplication | deepseek/deepseek-r1-distill-qwen-14b:free | 6184 | 6.18 |
| division | openai/gpt-3.5-turbo | 790 | 0.79 |
| division | openai/gpt-4o-mini | 823 | 0.82 |
| division | openrouter/quasar-alpha | 855 | 0.85 |
| division | deepseek/deepseek-r1-distill-qwen-14b:free | 1502 | 1.50 |
| web_content | deepseek/deepseek-r1-distill-qwen-14b:free | 263 | 0.26 |
| web_content | openai/gpt-3.5-turbo | 3311 | 3.31 |
| web_content | openrouter/quasar-alpha | 8305 | 8.30 |
| web_content | openai/gpt-4o-mini | 10048 | 10.05 |

## Summary

- Total Tests: 16
- Passed: 12
- Failed: 4
- Success Rate: 75.00%
- Average Duration: 2585ms (2.58s)

## Failed Tests

### web_content - openai/gpt-3.5-turbo

- Prompt: `Check if the content contains a section about Human prehistory. Reply with "yes" if it does, "no" if it does not.`
- Expected: `yes`
- Actual: ``
- Duration: 3311ms (3.31s)
- Reason: Model returned empty response
- Timestamp: 4/6/2025, 5:42:26 PM

### web_content - deepseek/deepseek-r1-distill-qwen-14b:free

- Prompt: `Check if the content contains a section about Human prehistory. Reply with "yes" if it does, "no" if it does not.`
- Expected: `yes`
- Actual: ``
- Duration: 263ms (0.26s)
- Reason: Model returned empty response
- Timestamp: 4/6/2025, 5:42:26 PM

### web_content - openai/gpt-4o-mini

- Prompt: `Check if the content contains a section about Human prehistory. Reply with "yes" if it does, "no" if it does not.`
- Expected: `yes`
- Actual: ``
- Duration: 10048ms (10.05s)
- Reason: Model returned empty response
- Timestamp: 4/6/2025, 5:42:36 PM

### web_content - openrouter/quasar-alpha

- Prompt: `Check if the content contains a section about Human prehistory. Reply with "yes" if it does, "no" if it does not.`
- Expected: `yes`
- Actual: ``
- Duration: 8305ms (8.30s)
- Reason: Model returned empty response
- Timestamp: 4/6/2025, 5:42:44 PM

## Passed Tests

### addition - openai/gpt-3.5-turbo

- Prompt: `add 5 and 3. Return only the number, no explanation.`
- Expected: `8`
- Actual: `8`
- Duration: 1157ms (1.16s)
- Timestamp: 4/6/2025, 5:42:04 PM

### addition - deepseek/deepseek-r1-distill-qwen-14b:free

- Prompt: `add 5 and 3. Return only the number, no explanation.`
- Expected: `8`
- Actual: `8`
- Duration: 4214ms (4.21s)
- Timestamp: 4/6/2025, 5:42:08 PM

### addition - openai/gpt-4o-mini

- Prompt: `add 5 and 3. Return only the number, no explanation.`
- Expected: `8`
- Actual: `8`
- Duration: 726ms (0.73s)
- Timestamp: 4/6/2025, 5:42:09 PM

### addition - openrouter/quasar-alpha

- Prompt: `add 5 and 3. Return only the number, no explanation.`
- Expected: `8`
- Actual: `8`
- Duration: 814ms (0.81s)
- Timestamp: 4/6/2025, 5:42:10 PM

### multiplication - openai/gpt-3.5-turbo

- Prompt: `multiply 8 and 3. Return only the number, no explanation.`
- Expected: `24`
- Actual: `24`
- Duration: 826ms (0.83s)
- Timestamp: 4/6/2025, 5:42:11 PM

### multiplication - deepseek/deepseek-r1-distill-qwen-14b:free

- Prompt: `multiply 8 and 3. Return only the number, no explanation.`
- Expected: `24`
- Actual: `24`
- Duration: 6184ms (6.18s)
- Timestamp: 4/6/2025, 5:42:17 PM

### multiplication - openai/gpt-4o-mini

- Prompt: `multiply 8 and 3. Return only the number, no explanation.`
- Expected: `24`
- Actual: `24`
- Duration: 856ms (0.86s)
- Timestamp: 4/6/2025, 5:42:18 PM

### multiplication - openrouter/quasar-alpha

- Prompt: `multiply 8 and 3. Return only the number, no explanation.`
- Expected: `24`
- Actual: `24`
- Duration: 684ms (0.68s)
- Timestamp: 4/6/2025, 5:42:18 PM

### division - openai/gpt-3.5-turbo

- Prompt: `divide 15 by 3. Return only the number, no explanation.`
- Expected: `5`
- Actual: `5`
- Duration: 790ms (0.79s)
- Timestamp: 4/6/2025, 5:42:19 PM

### division - deepseek/deepseek-r1-distill-qwen-14b:free

- Prompt: `divide 15 by 3. Return only the number, no explanation.`
- Expected: `5`
- Actual: `5`
- Duration: 1502ms (1.50s)
- Timestamp: 4/6/2025, 5:42:21 PM

### division - openai/gpt-4o-mini

- Prompt: `divide 15 by 3. Return only the number, no explanation.`
- Expected: `5`
- Actual: `5`
- Duration: 823ms (0.82s)
- Timestamp: 4/6/2025, 5:42:22 PM

### division - openrouter/quasar-alpha

- Prompt: `divide 15 by 3. Return only the number, no explanation.`
- Expected: `5`
- Actual: `5`
- Duration: 855ms (0.85s)
- Timestamp: 4/6/2025, 5:42:22 PM