mono/packages/kbot/tests/unit/math-report.md

2.0 KiB

Math Test Results

Failed Tests

Passed Tests

factorial - deepseek/deepseek-chat:free

  • Prompt: calculate the factorial of 5 (5!). Return only the number, no explanation.
  • Expected: 120
  • Actual: 120
  • Timestamp: 4/1/2025, 12:42:00 PM

factorial - google/gemini-2.0-flash-exp:free

  • Prompt: calculate the factorial of 5 (5!). Return only the number, no explanation.
  • Expected: 120
  • Actual: 120
  • Timestamp: 4/1/2025, 12:42:02 PM

factorial - gpt-4

  • Prompt: calculate the factorial of 5 (5!). Return only the number, no explanation.
  • Expected: 120
  • Actual: 120
  • Timestamp: 4/1/2025, 12:42:03 PM

fibonacci - deepseek/deepseek-chat:free

  • Prompt: calculate the first 5 numbers of the fibonacci sequence. Return only the numbers separated by commas, no explanation.
  • Expected: 0,1,1,2,3
  • Actual: 0,1,1,2,3
  • Timestamp: 4/1/2025, 12:41:49 PM

fibonacci - google/gemini-2.0-flash-exp:free

  • Prompt: calculate the first 5 numbers of the fibonacci sequence. Return only the numbers separated by commas, no explanation.
  • Expected: 0,1,1,2,3
  • Actual: 0,1,1,2,3
  • Timestamp: 4/1/2025, 12:42:10 PM

fibonacci - gpt-4

  • Prompt: calculate the first 5 numbers of the fibonacci sequence. Return only the numbers separated by commas, no explanation.
  • Expected: 0,1,1,2,3
  • Actual: 0, 1, 1, 2, 3
  • Timestamp: 4/1/2025, 12:42:12 PM

quadratic - deepseek/deepseek-chat:free

  • Prompt: solve the quadratic equation x² + 5x + 6 = 0. Return only the roots as a JSON array, no explanation.
  • Expected: [-3,-2]
  • Actual: [-2, -3]
  • Timestamp: 4/1/2025, 12:42:16 PM

quadratic - google/gemini-2.0-flash-exp:free

  • Prompt: solve the quadratic equation x² + 5x + 6 = 0. Return only the roots as a JSON array, no explanation.
  • Expected: [-3,-2]
  • Actual: [-2.0, -3.0]
  • Timestamp: 4/1/2025, 12:42:17 PM

quadratic - gpt-4

  • Prompt: solve the quadratic equation x² + 5x + 6 = 0. Return only the roots as a JSON array, no explanation.
  • Expected: [-3,-2]
  • Actual: [-2, -3]
  • Timestamp: 4/1/2025, 12:42:18 PM