WeTestAthens: Postman's AI & Automation Techniques

Postman's AI and Automation Techniques

1. All rights reserved by Postman Inc
Postman’s AI
and Automation
Techniques

Pooja Mistry
Developer Advocate
@poojamakes
Revolutionizing API Testing

2. Let’s start off by taking a trip
down memory lane …
the year was 2015

4. Manual Testing
at its Finest

5. UI Changes result in
many broken tests

6. We had to make
the switch

7. Goal was to empower
manual testers into
becoming software
test developers

8. However there was
a lot of disconnect

10. We ended up here

11. Discovered
Postman

12. Finally ended
up here

13. Flash forward
to 2022

14. Hi,
my name is Pooja
@poojamakes
•Developer Advocate, Postman
•Educating others about Postman is my Full Time Job!
•For many teams, Postman is an everyday tool that
helps people work with APIs more efficiently
@poojamakes

18. Making the switch:

Empowering manual
testers to automate their
API tests

19. API Testing Methods

20. Types of API Tests

21. Starting with a good testing plan is essential
Regardless of whether performing manual or automated testing, these are the
three major things everyone should do when embarking on the API testing process:
Understand the API’s
requirements

01
Specify the expected
inputs and outputs
02
Organize tests with similar
functionality
03

22. Inputs and Outputs

23. What should I test for ?
Correct status codes.
Response format (i.e. valid JSON)
Various error conditions, such as invalid input, missing required parameters, or exceeding rate limits.
Content-Type header based on the response format (e.g., "application/json" for JSON responses).
Authentication and authorization are enforced.
Data is accurate and matches the expected values.

24. Testing is a crucial part of API Projects

25. So much more to Postman than just sending requests ….
Postman API templates testing proxies
documentation collection runner Workspaces
authentication environments open-source projects
Newman JSON collaboration mock
servers CLI Interceptor runtime Monitors
converters automation variables integrations
version control API Network session Postman sandbox

26. Collections
the building blocks of
API development

Highly extensible, providing the
foundation to tackle org-wide API
initiatives at any scale.

28. Workspaces
the shared canvas for
executing & collaborating
on API assets

Enable an array of team types to
leverage Collections for API workflows.

30. Scripts
the logic provided to drive
dynamic workflows
Enable dynamic behavior to your API
requests with Postman's built-in JavaScript
runtime

32. Package Library

33. Status Code
pm.test("Status code is 201", () => {
pm.response.to.have.status(201);
});
Test a successful response
pm.test("Successful POST request" , ()=> {
pm.expect(pm.response.code).to.be.oneOf(
[200,201]);
});
Test that a status code is one
of a set of status codes

34. Response Format
const jsonData = pm.response.json();
pm.test("Test data type of the response" , () => {
pm.expect(jsonData.age).to.be.a("number");
pm.expect(jsonData.hobbies).to.be.an("array");
pm.expect(jsonData.email).to.be.null;
});
pm.test("Test valid json", function() {
pm.response.to.be.json;
});
Test the value types of a response Test that response is JSON

35. Test that the response time to be within a specified range
pm.test("Response time is less than 200ms" , () => {
pm.expect(pm.response.responseTime).to.be.below(200);
});
Response Time

36. Data Accuracy
pm.test("Check that invoice is paid" , function () {
pm.expect(pm.response.json().invoicePaid).to.eql(true);
});
pm.test("Response property matches environment variable" , function () {
pm.expect(pm.response.json().name).to.eql(pm.environment.get("name"));
});

Check if response property matches a hardcoded value
Check if a response property has the same value as a variable

37. Contract Tests
Test that the response validates contract
var contract = {
type: "array",
items: {
type: "object",
properties: {
title: { type: "string" },
author: { type: "string" },
id: { type: "string" },
},
required: ["title", "author", "id"]
}
};
pm.test("API response matches the predefined contract" , function () {
var response = pm.response.json();
pm.expect(tv4.validate(response, contract)).to.be.true;
});

39. Where Does
AI Play a Role ?

40. In the age of AI
Everything is an API.”

Abhinav Asthana
CEO - Postman
“

41. Postbot is your
AI Assistant
“As our technologies have
improved, so have our abilities”

42. Postbot’s goal is to increase developer productivity
by saving time writing API tests and documentation,
and helping debug requests.

43. How can Postbot help you
Postbot is your AI assistant
for API workflows in Postman
Postbot can help you:
Write tests
Visualize responses
Get help using AI Expert Curated Support
Write documentation
Debug

44. Increase productivity
through Test Script
Generation

45. In a request, Postbot will
provide contextual information
to guide the developer.
●“Add tests to this request”
●“Test for response”
Individual
Tests

46. Autocomplete allows developers
to use natural language to
write tests
●After the creating the test
name pause after the
closing single quotation
●
●Need to have a valid
response before using
autocomplete
●
●Like other copilots, tab to
confirm autocomplete
Autocomplete

47. Quickly debug issues
with requests
●Postbot can debug and
resend requests for you
●
●Googling issues is
so last year.
●
Fix Tests

48. Visualize
Responses
TIME SAVED

49. Create visual representation
of JSON responses
●No more scrolling through
endless JSON objects
●
●Non-developers can
quickly understand
response data
Visualization

50. Documentation
Generation
No more tribal knowledge

51. Writing documentation is made
simpler through Postbot
●No excuse to not write
documentation
●
●Easy tribal knowledge
transfer
Documentation

52. Postman AI
Expert Support
IN APP CURATED

53. You can ask Postbot questions
about Postman app and it'll
respond with expertly curated
instruction from multiple sources.
Postman
Support

54. v
Let’s talk about
Automation

55. Collection Runner

56. CI/CD - Postman CLI

57. CI/CD - Automation

58. Scheduled Runs

59. Flows

60. End-To End -
Picture

66. Thank you
@poojamakes

68. Means of Test Automation

70. What we covered