Specmatic rejects external examples containing invalid requests without body

[jhomswk]

Description:

Hi! 👋

Specmatic seems to reject external examples containing invalid requests without body
even though the status code indicates an error.

Please, let me know whether I am missing something.
Thank you in advance.

Minimal Example:

🧾 OpenAPI specification:

openapi: 3.0.0

info:
  title: Users Service
  version: 1.0.0

servers:
  - url: http://localhost:9000

paths:
  /register-user:
    post:
      requestBody:
        content:
          application/json:
            schema:
              type: object
              properties:
                id:
                  type: string
                  format: uuid
              required:
                - id
      responses:
        201:
          description: user successfully registered
        400:
          description: validation error

✔️ Example 1 - valid request - works:

{
  "http-request": {
    "path": "/register-user",
    "method": "POST",
    "headers": {
      "Content-Type": "application/json"
    },
    "body": {
      "id": "4cee792f-6a93-43ec-80c7-a4f2e4e9ed49"
    }
  },
  "http-response": {
    "status": 201
  }
}

✔️ Example 2 - invalid id - works:

{
  "http-request": {
    "path": "/register-user",
    "method": "POST",
    "headers": {
      "Content-Type": "application/json"
    },
    "body": {
      "id": "invalid"
    }
  },
  "http-response": {
    "status": 400
  }
}

✔️ Example 3 - missing id - works:

{
  "http-request": {
    "path": "/register-user",
    "method": "POST",
    "headers": {
      "Content-Type": "application/json"
    },
    "body": {
    }
  },
  "http-response": {
    "status": 400
  }
}

❌ Example 4 - missing body - fails:

{
  "http-request": {
    "path": "/register-user",
    "method": "POST"
  },
  "http-response": {
    "status": 400
  }
}

💻 Error:

Steps To Reproduce:

I have prepared a small repository that can be used to reproduce the issue.

• git clone https://github.com/jhomswk/specmatic-invalid-requests-missing-body
• execute docker compose up
• check the logs of the specmatic container

System Information:

• image: znsio/specmatic:2.0.48

[harikrishnan83]

@jhomswk Thanks again for the detailed bug report. Really appreciate the sample repo.

This issue looks quite similar to #1494 (the difference being that here the empty body is not being accepted for 400 response examples) and here is a link to a comment I have added on that issue. Even here even if you do to explicitly set a 400 example with empty body, Specmatic Stub server will already return 400 for such requests. Hope this helps.