mono/packages/kbot/tests/unit/reports/basic.md
2025-04-02 13:04:20 +02:00

1.7 KiB

Basic Operations Test Results

Highscores

addition

  1. anthropic/claude-3.5-sonnet: 1888ms (1.89s)
  2. qwen/qwq-32b: 6304ms (6.30s)

multiplication

  1. anthropic/claude-3.5-sonnet: 1291ms (1.29s)
  2. qwen/qwq-32b: 2225ms (2.23s)

division

  1. anthropic/claude-3.5-sonnet: 1209ms (1.21s)
  2. qwen/qwq-32b: 7852ms (7.85s)

Summary

  • Total Tests: 6
  • Passed: 6
  • Failed: 0
  • Success Rate: 100.00%
  • Average Duration: 3462ms (3.46s)

Failed Tests

No failed tests

Passed Tests

addition - anthropic/claude-3.5-sonnet

  • Prompt: add 5 and 3. Return only the number, no explanation.
  • Expected: 8
  • Actual: 8
  • Duration: 1888ms (1888.00s)
  • Timestamp: 4/2/2025, 1:01:08 PM

addition - qwen/qwq-32b

  • Prompt: add 5 and 3. Return only the number, no explanation.
  • Expected: 8
  • Actual: 8
  • Duration: 6304ms (6304.00s)
  • Timestamp: 4/2/2025, 1:01:15 PM

multiplication - anthropic/claude-3.5-sonnet

  • Prompt: multiply 8 and 3. Return only the number, no explanation.
  • Expected: 24
  • Actual: 24
  • Duration: 1291ms (1291.00s)
  • Timestamp: 4/2/2025, 1:01:16 PM

multiplication - qwen/qwq-32b

  • Prompt: multiply 8 and 3. Return only the number, no explanation.
  • Expected: 24
  • Actual: 24
  • Duration: 2225ms (2225.00s)
  • Timestamp: 4/2/2025, 1:01:18 PM

division - anthropic/claude-3.5-sonnet

  • Prompt: divide 15 by 3. Return only the number, no explanation.
  • Expected: 5
  • Actual: 5
  • Duration: 1209ms (1209.00s)
  • Timestamp: 4/2/2025, 1:01:19 PM

division - qwen/qwq-32b

  • Prompt: divide 15 by 3. Return only the number, no explanation.
  • Expected: 5
  • Actual: 5
  • Duration: 7852ms (7852.00s)
  • Timestamp: 4/2/2025, 1:01:27 PM