README: update, add twitter to Atom example - tscrape - twitter scraper
(HTM) git clone git://git.codemadness.org/tscrape
(DIR) Log
(DIR) Files
(DIR) Refs
(DIR) README
(DIR) LICENSE
---
(DIR) commit 8af4c93ad7dee6454abd9da106b9f3e37e1ce400
(DIR) parent 2872a29d4f44afbfa4f439ba1f3d84c22114b0d4
(HTM) Author: Hiltjo Posthuma <hiltjo@codemadness.org>
Date: Mon, 22 Apr 2019 14:46:41 +0200
README: update, add twitter to Atom example
Diffstat:
M README | 20 +++++++++++++++++++-
1 file changed, 19 insertions(+), 1 deletion(-)
---
(DIR) diff --git a/README b/README
@@ -12,7 +12,25 @@ $ make
Usage
-----
-curl --http1.0 -H 'User-Agent:' -s 'https://twitter.com/namehere' | tscrape
+ curl --http1.0 -H 'User-Agent:' -s 'https://twitter.com/namehere' | tscrape
+
+or
+
+ ftp -o - -U '' 'https://twitter.com/namehere' 2>/dev/null | tscrape
+
+or
+
+ hurl 'https://twitter.com/namehere' | tscrape
+
+
+Using sfeed to convert the tscrape TSV output to an Atom feed:
+
+ hurl 'https://twitter.com/namehere' | tscrape | \
+ LC_ALL=C awk 'BEGIN { OFS = FS = "\t"; }
+ {
+ print $1 OFS $4 OFS "https://twitter.com/" $6 "/status/" $5 \
+ OFS "" OFS "" OFS $5 OFS $7 OFS "";
+ }' | sfeed_atom
Why