v1.6.5

What's Changed

• Added favicon_url in output with -favicon option by @Ice3man543 in #1774

# OPTION
-favicon  display mmh3 hash for '/favicon.ico' file

# EXAMPLE
$ echo hackerone.com | ./httpx -favicon -j -silent | jq -r .favicon_url
https://hackerone.com/favicon.ico

• Fixed issues with favicon detection + SDK update by @Ice3man543 in #1774
• Fixed panic issue with wappalyzer by @dogancanbakir in #1777

Full Changelog: v1.6.4...v1.6.5

v1.6.4

What's Changed

🎉 New Features

• Added -efqdn option to extract subdomans from response header and body by @RamanaReddy0M in #1733

# OPTION
-extract-fqdn, -efqdn  get domain and subdomains from response body and header in jsonl/csv output

# EXAMPLE
$ echo tesla.com | ./httpx -efqdn -j -fr  | jq .

• Added support to exclude response body with -sr option by @saeed0x1 in #1671

# OPTION
-ob, -omit-body  omit response body in output

# EXAMPLE
$ echo hackerone.com | ./httpx -store-response -omit-body

• Added support for multiple input for filter options by @dogancanbakir in #1761

🐞 Bug Fixes

• Fixed issue with empty host by @dogancanbakir in #1759
• Fixed issue with missing 1XX status code in output by @dogancanbakir in #1760

Other Changes

• Added http based speed control (SDK) by @dogancanbakir in #1762
• Ảdded support to use networkpolicy + wappalyzer singletons (SDK) by @Ice3man543 in #1769

New Contributors

• @saeed0x1 made their first contribution in #1671

Full Changelog: v1.6.3...v1.6.4

v1.6.3

What's Changed

🐞 Bug Fixes

• Fixed issue with tech detection output in default run by @dogancanbakir in #1732
• Fixed issue with -sr option to respect filters/matchers by @Mzack9999 in #1720

Full Changelog: v1.6.2...v1.6.3

v1.6.2

What's Changed

🎉 New Features

• Added resolvers information in output by @Mzack9999 in #1718

🐞 Bug Fixes

• Fixed nil deref by @dogancanbakir in #1719

Other Changes

• bump version by @dogancanbakir in #1717

Full Changelog: v1.6.1...v1.6.2

v1.6.1

What's Changed

🎉 New Features

• Added -protocol option for force http 1.1 connection by @Mzack9999 in #1669

   -pr, -protocol string  protocol to use (unknown, http11)

🐞 Bug Fixes

• Added AAAA dns type in JSONL for IPv6 by @Mzack9999 in #1668

Other Changes

• Fixed content rel issues by @dogancanbakir in #1630
• Added CanHaveTitleTag Function for MIME Type Validation by @redyetidev in #1608
• Updated -tech-detect flag var type by @dogancanbakir in #1702
• Updated wappalyzer-go + misc additions by @Ice3man543 in #1699

New Contributors

• @redyetidev made their first contribution in #1608

Full Changelog: v1.6.0...v1.6.1

v1.6.0

What's Changed

• Fixed issue with -csv format including response header/body as default by @RamanaReddy0M in #1618
• Fixed issue with -exclude option by @dogancanbakir in #1617
• Updated default JSONL output fields by @RamanaReddy0M in #1614
  • Added tech and cdn, cdn_name, can be optionally disabled (-tech-detect=false)
  • Removed hash, can be optionally enabled (-hash md5,mmh3)

{
  "timestamp": "2024-03-02T02:37:52.116518+05:30",
-  "hash": {
-    "body_md5": "84238dfc8092e5d9c0dac8ef93371a07",
-    "body_mmh3": "-1139337416",
-    "body_sha256": "ea8fac7c65fb589b0d53560f5251f74f9e9b243478dcb6b3ea79b5e36449c8d9",
-    "body_simhash": "9899951357530060719",
-    "header_md5": "1892a0082f71e142d1972cd0ad94416b",
-    "header_mmh3": "-1939422575",
-    "header_sha256": "fac11d1b8a4259066455332206523eb94ff2da43d408873e7d4246cebf855716",
-    "header_simhash": "14461785313525862383"
-  },
  "port": "443",
  "url": "https://example.com",
  "input": "example.com",
  "title": "Example Domain",
  "scheme": "https",
  "webserver": "ECS (dce/2694)",
  "content_type": "text/html",
  "method": "GET",
  "host": "93.184.216.34",
  "path": "/",
  "time": "1.248762166s",
  "a": [
    "93.184.216.34",
    "2606:2800:220:1:248:1893:25c8:1946"
  ],
+  "tech": [
+    "Amazon ECS",
+    "Amazon Web Services",
+    "Azure",
+    "Azure CDN",
+    "Docker"
+  ],
+  "cdn_name": "google",
+  "cdn": true,
  "words": 298,
  "lines": 47,
  "status_code": 200,
  "content_length": 1256,
  "failed": false,
  "knowledgebase": {
    "PageType": "nonerror",
    "pHash": 0
  }
}

Caution

Updated default JSONL output fields by @RamanaReddy0M in #1614

Full Changelog: v1.5.0...v1.6.0

v1.5.0

Warning

This release upgrades ASNMap to the latest version that uses an authenticated API. If you utilize the -asn option of httpx, one time configuration is required to set up PDCP API Key. You can do this using the -auth option or through setting up an environment variable, such as export PDCP_API_KEY=xxxxx

What's Changed

• Updated to authenticated ASNMap client by @RamanaReddy0M in #1595
• Fixed issue with -exclude option by @dogancanbakir in #1597

Full Changelog: v1.4.0...v1.5.0

v1.4.0

What's Changed

🔨 Maintenance

• Updated useragent library by @dogancanbakir in #1562
• Fixed exclude cdn option by @RamanaReddy0M in #1553
• Added sdk stream test by @Mzack9999 in #1578

Full Changelog: v1.3.9...v1.4.0

v1.3.9

What's Changed

🔨 Maintenance

• Fixed multiple issues related high memory uses by @Mzack9999 in #1547

Full Changelog: v1.3.8...v1.3.9

v1.3.8

What's Changed

• ⚠️ Removed -ec option in favor of newly added -exclude option ⚠️

---

• Added customizable -exclude option by @dogancanbakir in #1517

   -e, -exclude string[]  exclude host matching specified filter ('cdn', 'private-ips', cidr, ip, regex)

• Added timeout option for screenshot by @yoshino-s in #1516

   -st, -screenshot-timeout int     set timeout for screenshot in seconds (default 10)

• Added option to set custom headless options by @seeyarh in #1343

   -ho, -headless-options string[]  start headless chrome with additional options

• Fixed issue with use of system resolver with custom resolver input by @karelorigin in #1541
• Fixed issue with existing response directory by @dogancanbakir in #1451
• Fixed issue with -websocket and -pipeline detection by @RamanaReddy0M in #1528
• Fixed issue with redirects with -ports option by @RamanaReddy0M in #1529
• Fixed issue with -tls-probe option by @CyberStryk in #1461

New Contributors

• @PeterDaveHello made their first contribution in #1497
• @olearycrew made their first contribution in #1495
• @CyberStryk made their first contribution in #1461
• @yoshino-s made their first contribution in #1516

Full Changelog: v1.3.7...v1.3.8