Add a comment about how to avoid scraping and enabling pagination. - gophercgis - Collection of gopher CGI/DCGI for geomyidae
(HTM) hg clone https://bitbucket.org/iamleot/gophercgis
(DIR) Log
(DIR) Files
(DIR) Refs
(DIR) README
(DIR) LICENSE
---
(DIR) changeset 621411a3bc8c7ae7e520d594581d6a16f4ff6360
(DIR) parent 1f1487c94a4a517070022981d7898ed597ba410e
(HTM) Author: Leonardo Taccari <iamleot@gmail.com>
Date: Sun, 26 Aug 2018 11:45:36
Add a comment about how to avoid scraping and enabling pagination.
Diffstat:
internazionale/sections.dcgi | 11 +++++++++++
1 files changed, 11 insertions(+), 0 deletions(-)
---
diff -r 1f1487c94a4a -r 621411a3bc8c internazionale/sections.dcgi
--- a/internazionale/sections.dcgi Sun Aug 26 00:38:30 2018 +0200
+++ b/internazionale/sections.dcgi Sun Aug 26 11:45:36 2018 +0200
@@ -1,5 +1,16 @@
#!/bin/sh
+#
+# It seems that in order to enable pagination the following HTTP GET requests
+# are done:
+#
+# <https://data.internazionale.it/stream_data/items/ultimi-articoli/0/0/$(date +'%Y-%m-%d_%H-%M-%S').json>
+#
+# Instead of scraping the HTML page only for the last articles this can be
+# reused in order to get more data to build the DCGI and to enable
+# pagination.
+#
+
ARTICLE_CGI="/cgi/internazionale/article.cgi"