• Get application security done the right way! Detect, Protect, Monitor, Accelerate, and more…
  • One of the essential skills for a developer and sysadmin is to debug the application, API, or services, and knowing the right tools is a life-saver.

    What is Debugging?

    If you watch crime dramas, then the idea behind debugging will not be alien to you. Debugging is a process, and it involves a lot of tactics. It is the systematic finding and resolving problems and errors within a program.

    Besides, debugging sorts out all the issues that can prevent the correct operation of software or, in this case, the web application. The process of debugging your API or web application primarily involves an attempt to reproduce the problem.

    Consequently, the need to send out an API request emerges. Now, this is where the problem lies. Most browsers will prevent you from changing the origin header, and even the limits on URL size.

    In other words, to reproduce the issue, you may need to perform some HTTP manipulations. And this will require some powerful debugging tools.

    All the components or tactics of  the debugging process includes;

    • Interactive debugging
    • Control flow analysis
    • Unit testing
    • Integration testing
    • Logfile analysis
    • Monitoring
    • Memory Dumps
    • Profiling

    It is interesting to know that some HTTP clients, i.e., web browsers, have in-built web developer tools. These tools can be used to debug APIs. With this in mind, it is not necessary to write your debugging tool.

    What is HTTP Client?

    Suppose you think of building a system that leverages the HTTP protocol for distributed communication or HTTP-aware, such as a web application. Then you may want to look at the HTTP client component.

    The HTTP, or HyperText Transfer Protocol, is the reason you can communicate or transfer data on the web, every time you type in a URL. It is an application protocol that makes browsing the internet possible.

    Now, the HTTP Client is a system that sends requests to a server in HTTP text format, and in turn, receives a response from the same server.

    It is essential to know the differences between an HTTP client and the HTTP server.

    Differences Between HTTP Client and Server

    While the HTTP client is often web browsers or utility, HTTP servers act as proxies to application servers.

    In simpler words, your smartphones, TVs, PlayStation, really any device that can connect to the internet, is probably using an HTTP Client.

    Similarly, the HTTP server is the network computer that the HTTP client connects to. The relationship they share is more of a conversational one. Where the HTTP client sends a request and the HTTP server responds.

    Examples of HTTP Requests

    Requests Outcomes
    GET Requests the entire resource
    HEAD Requests resource without the body
    POST Adds content to an existing web resource
    PUT Modifies an existing web resource
    DELETE Removes a specified resource
    TRACE Shows the changes to a web resource
    OPTIONS Shows available HTTP methods for the URL
    CONNECT Converts the request connection to a transparent TCP/IP tunnel
    PATCH Partially modifies a web resource

    Debugging the web has never been easier. With these tools, you can finally relax while you do what you enjoy.

    HTTPie

    The ultimate aim of HTTPie is to make CLI interaction with web services user interface friendly. This tool provides an HTTP command for sending requests, all with the use of a natural syntax.

    HTTPie can be used for debugging, testing, and connecting with HTTP servers. It supports HTTP, HTTPS, and proxies.

    Highlights

    • Built-in JSON support system
    • Can be installed on Windows, macOS, and Linux
    • Custom HTTP headers and method
    • Submit forms
    • Offline mode
    • Basic and digest authentication
    • Intuitive syntax

    Don’t want to install HTTPie locally?

    No worries, now you can run it online.

    Fiddler

    Fiddler is a cross-platform web debugging proxy. It can help manipulate web sessions, inspect HTTPS traffic, and monitor traffic between your computer and the Internet.

    You can install Fiddler on Windows, macOS, and Linux. It is probably the most popular tool to debug traffic.

    RESTer

    RESTer is available as an extension for Google Chrome and Firefox.

    Highlights

    • Authorization headers with Basic or Auth2 authentication
    • View request history
    • Perform requests with any method, URL, body, and custom headers
    • Testing and debugging APIs

    Paw

    Paw is a full-featured HTTP client, which allows you to send all kinds of HTTP requests. With Paw, you can test your APIs and also explore new ones.

    Paw is exclusively built for macOS, and it has features that are easy to use. You can import and generate swagger, RAML, etc. and it supports JSON schema.

    Highlights

    • Supports multiple authentications like basic, OAuth, hawk, digest
    • Dynamic values
    • Environments
    • Extend through java-script based extensions
    • Cookies and session manipulation

    Requester

    Requester is a robust client that combines the features of HTTPie, Postman, and Paw. It works only with Sublime Text editor.

    Highlights

    • Supports JSON Schemer
    • Request collections and history
    • Colorized output with syntax highlighting
    • Modern UX
    • Cookies, custom headers, request body, and query parameters are easy to set.
    • GraphQL support

    Postman

    Always working on APIs?

    You’ll fall in love with Postman.

    Postman is unarguably one of the more popular HTTP clients used for debugging web applications. It allows for faster and easier API development.

    Highlights

    • Packs a powerful GUI, with a user-friendly interface
    • History of requests
    • Automated testing with collection runner
    • Flexible API monitoring
    • Support REST, GraphQL, SOAP
    • Multiple payloads support including JSON and HTML

    cURL

    cURL is a command-line tool that is used for sending data using URL syntax.

    The good thing, cURL is by default installed on most of the UNIX-flavored operating systems. It supports many protocols, including FTP, LDAP, POP3, SMTP, GOPHER, IMAP, HTTP, HTTPS, and SCP.

    Charles Proxy

    As the name says, Charles proxy is an HTTP and reverse proxy. It works by routing local traffic through it.

    You can use Charles for SSL proxying, bandwidth throttling, AJAX debugging, breakpoints, and more.

    Whistle

    Whistle is a NodeJS-based cross-platform debugging tool to capture and manipulate HTTP, HTTPS, WebSocket, and TCP traffic.

    First, you need to install NodeJS and then Whistle using npm.

    npm install -g whistle

    You can always extend the features with the plugin if default features don’t suit your requirements.

    mitmproxy

    mitmproxy is a popular open-source HTTPS proxy among security researchers. Use it as a CLI, web, or Python API.

    The web interface gives you the look and feel of Chrome developer tools. It supports HTTP/2 as well.

    Proxyman

    Similar to the above-mentioned Paw, Proxyman is a premium native macOS web debugging proxy application.

    It acts as a man-in-the-middle for web traffic and offers many features, including the following.

    • SSL proxy
    • Repeat requests
    • Protobuf
    • ReWrite scripting
    • Local and remote map
    • Content filtering
    • Syntax highlighting

    Proxyman UI is very human friendly.

    HTTP Toolkit

    HTTP Toolkit is an open-source HTTP debugger. It’s a desktop app available for Windows, Mac & Linux.

    Unlike other HTTP debuggers, HTTP Toolkit provides automatically targeted interception for specific clients, including HTTPS setup, rather than intercepting everything from your entire computer, and so avoids capturing irrelevant traffic or disrupting other applications.

    With one click you can intercept browser windows (including Chrome, Firefox, and more), backend/scripting languages like Node.js, Python, and PHP, any command-line tools, Electron apps, or Android devices & emulators (including system-level HTTPS interception).

    HTTP Toolkit supports standard HTTP debugger features including breakpoints & rewriting HTTP(S) traffic, filtering and searching collected traffic, and highlighting & autoformatting for many popular request & response body formats. Core features to intercept, inspect & rewrite HTTP(S) are all available for free, while some advanced premium features like import/export and automated mock rules require a paid account.

    Conclusion

    The above HTTP clients and web debugging proxy can help you in many ways. Most of them are free or offer a trial so try some of them to see what works for you.

    Happy troubleshooting!