diff options
| author | Tatsuya Kinoshita <tats@debian.org> | 2020-12-19 04:20:49 +0000 |
|---|---|---|
| committer | Tatsuya Kinoshita <tats@debian.org> | 2020-12-19 04:25:29 +0000 |
| commit | 1d967a4d423c0571a86d319ac16d704bbf29e51a (patch) | |
| tree | a36d9d7a43e048f908320fd68bd43ff08fe5d4cb /doc/README.siteconf | |
| parent | Update ChangeLog (diff) | |
| download | w3m-1d967a4d423c0571a86d319ac16d704bbf29e51a.tar.gz w3m-1d967a4d423c0571a86d319ac16d704bbf29e51a.zip | |
Add examples of siteconf, set user_agent to Googlebot for Twitter
Diffstat (limited to 'doc/README.siteconf')
| -rw-r--r-- | doc/README.siteconf | 6 |
1 files changed, 6 insertions, 0 deletions
diff --git a/doc/README.siteconf b/doc/README.siteconf index 0369926..8514edf 100644 --- a/doc/README.siteconf +++ b/doc/README.siteconf @@ -47,6 +47,12 @@ user_agent "Lynx/2.8.8dev.3 libwww-FM/2.14 SSL-MM/1.4.1" Tell Google we're actually Lynx. (So they send us a text-browser friendly results page.) +url m!^https?://([a-z]+\.)?twitter\.com/! +user_agent "Googlebot/2.1" + +Tell Twitter we're actually Googlebot. (So they send us a page without +rejection of a JavaScript disabled browser.) + ===== Regular expressions notes ===== Following expressions are all equivalent: |