Misidentified user-agents as bots

[sagrawal31]

Description

A few user agents are being treated as bots but do not seem to be-

• Mozilla/5.0 (Linux; Android 9; Eluga I8 Build/PPR1.180610.011; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/121.0.6167.178 Mobile Safari/537.36 Instagram 340.0.0.14.109 Android (28/9; 320dpi; 720x1371; PANASONIC/Panasonic; Eluga I8; Eluga_I8; mt6765; en_IN; 622085927)
• Mozilla/5.0 (Linux; Android 8.1.0; ELUGA X1 Build/O11019; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/126.0.6478.122 Mobile Safari/537.36 Instagram 337.0.0.35.102 Android (27/8.1.0; 480dpi; 1080x2102; PANASONIC/Panasonic; ELUGA X1; ELUGA_X1; mt6771; en_IN; 615043694)
• Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) WhatsApp/2.2424.0 Chrome/91.0.4472.164 Electron/13.6.9 Safari/537.36 (not sure about this)

Source of confirmation-

• IP geolocation and organization
• Kind of activities done on our website

[monperrus]

thanks for the report.

yes, whatsapp requests are considered as bots, see https://github.com/monperrus/crawler-user-agents/blob/708b496e7e7b674868b22289388d8c5329ae0575/crawler-user-agents.json

[sagrawal31]

Thanks @monperrus. What about the first two?

[sagrawal31]

One more-

Mozilla/5.0 (Linux; Android 12; SM-S906B Build/SP1A.210812.016; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/129.0.6668.100 Mobile Safari/537.36 [FBAN/WhatsAppSMBAndroid;FBAV/2.24.21.80;FBLC/en_US;FBSV/null;FBBR/null;FBBD/null;FBBV/null;FBCA/null;FBPN/null;FBDM/null;]

[monperrus]

Per my test, they are not considered as bot

>>> crawleruseragents.is_crawler("Mozilla/5.0 (Linux; Android 9; Eluga I8 Build/PPR1.180610.011; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/121.0.6167.178 Mobile Safari/537.36 Instagram 340.0.0.14.109 Android (28/9; 320dpi; 720x1371; PANASONIC/Panasonic; Eluga I8; Eluga_I8; mt6765; en_IN; 622085927)")
False
>>> crawleruseragents.is_crawler("Mozilla/5.0 (Linux; Android 8.1.0; ELUGA X1 Build/O11019; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/126.0.6478.122 Mobile Safari/537.36 Instagram 337.0.0.35.102 Android (27/8.1.0; 480dpi; 1080x2102; PANASONIC/Panasonic; ELUGA X1; ELUGA_X1; mt6771; en_IN; 615043694)")
False

could you clarify?