(DIR) one way ticket -- root
(DIR) all are welcom -- special pages
PC...is...the...LSD......⢀⡤⠞⠋⠡⣀⠃⠬⠔.⠁⠄........⠠⢐⢀.⠒⢕⠽⠿⢶⣄⡀....of...the...
1990s....PC...is...⠘⠤⠠⣀⠴⠏⠳⡀⣂⠨⡨⢊⠄⠦⠁⠉⠠⡠⠠....⠐.⡉⡂⢅⠪⠤⠰.⠎⡬⡚⢌⢛⡷⣤⡄...s...the..
.LSD...of...the....⣨⠶⠚⠭.⡂⠴⠡⡑⡩⢂⠒⣐⠩⣀⢀⢔⠊⡰..⣀⡐⢀⠁⡠⠱⣡⢑⠢..⠬.⡳⠡⡢⣊⢄⣻⢶⣄......1990
s....PC... ...⢀⠡⡣⡩⣊⠯⡫⠗⣽⣻⣦⡘.....th
e...LSD... Ph1o6 3ntry 180509_1036 ⠰⣈⠦⡐⣊⢒⠑⡥⣑⣷⣉⠙⣌⣾⢻⡄...f..
.the...199 ⢎⢎⢞⠵⡕⠔⠬⠈⡊⣦⠚⡤⡈⠖⣇⢝⣦...0s
....PC......⢀⠜..⢀⢀⠩⠐.⡡⢥⢉⠒⡂⠋⢎⢊⡁⠕⡵⢅⣗⢓⢝⠍⡮⢗⡈⠆..⡀⢮⢒⣪⢺⠴⡩⣋.⠁⡒.⠐⢄⠊⠊⠅⠑⢊⠴⡹⡨⡙⣧....
is...the...⣠⠺..⠐..⢀.⠤⡢⢂⢞⠨..⡈⡤⢊⠆⣏⢏⠭⠢⠱⠝⠨⠂⠑..⢄⠱⡙⠠⡣⡲⣓⢕⠔⠶⠰⡘⢀⠈⡂⢆.⠁⡀⡀⠉⢐⠵⠚⠜⣧...
e...L ⢖⠐⡘⡠⢅⡒⡭⡪⡁.⠨⡢⠱⣸⡇..
f.... #code ⣒⠥⡱⡵⠋⢍⢬⢜⠤⢉⢂⠢⡻⣬⣺⡇.
f.... ⣒⠥⡱⡵⠋⢍⢬⢜⠤⢉⢂⠢⡻⣬⣺⡇.
.th.. As you know I'm often biased in favor ⣢⠯⣂⢆⠿⣺⠙⡴⢀⠴⡓⠔⣝⢼⣭⣗.
he... of awk, so I just had to rewrite ⡢⡑⡭⢖⢍⡊⣾⠰⠪⠆⠅⢮⣊⢏⣷⣿.
he... mediawiki mwimport from perl. And here ⡢⡑⡭⢖⢍⡊⣾⠰⠪⠆⠅⢮⣊⢏⣷⣿.
..19. are results. ⣈⠎⢒⠭⣛⢮⢾⡰⢕⠂⠠⠗⢍⢚⢮⢻.
..19. ⣈⠎⢒⠭⣛⢮⢾⡰⢕⠂⠠⠗⢍⢚⢮⢻.
$ time ./mwimport.pl import.xml >/dev/null
./mwimport.pl import.xml > /dev/null 3.34s user 0.01s system 99% cpu 3.354 total
$ time ./mwimport.awk import.xml >/dev/null
./mwimport.awk import.xml > /dev/null 13.71s user 2.64s system 99% cpu 16.364 total
$ time ./mwrewrite.awk import.xml >/dev/null
./mwrewrite.awk import.xml 4.98s user 0.25s system 99% cpu 5.227 total
mwimport.awk was straightforward to write, it's usual pattern-matching
style of awk, like for example md2html kind of converters. It's easy to
read and extend. But somewhat as expected - it's dead slow.
OTOH rewrite didn't give desired improvement, so you have to live with
it until i find something. today awk sucks :c
WARNING: awk scripts are broken and won't convert mediawiki XML correctly!
UPDATE: and i finally found wtf after hours of polishing all bugs
there was critical typo in flush(), which should be:
dump_text = dump_page = dump_rev = ""
so now it's 1.1 second vs 3.5 with perl. Quite canonical ratio.
UPDATE2: pattern-matching styled example is now 1.5 seconds,
which is still 2 times better than perl.
Original perl mwimport: [1]
Awk rewrite (pattern-matching style): [2]
Rewrite of awk rewrite: [3]
..1990s....PC...is...the...LSD...of...⠆..⠠⡄...........⠠⠄⠂⠊...f...the...
1990s....PC...is...the...LSD...of.....⠈⡄..⠂.........⡠⠊.....the...1990s.
Links:
(HTM) [1] https://meta.wikimedia.org/wiki/Data_dumps/mwimport
(TXT) [2] mwimport.awk
(TXT) [3] mwrewrite.awk
PC...is...the...LSD......⢀⡤⠞⠋⠡⣀⠃⠬⠔.⠁⠄........⠠⢐⢀.⠒⢕⠽⠿⢶⣄⡀....of...the...
1990s....PC...is...⠘⠤⠠⣀⠴⠏⠳⡀⣂⠨⡨⢊⠄⠦⠁⠉⠠⡠⠠....⠐.⡉⡂⢅⠪⠤⠰.⠎⡬⡚⢌⢛⡷⣤⡄...s...the..
s....PC...is.....⢠⠚⢀⢠⠁⡵⢡⠡⡳⢁⡱⣘⠠⡻⠽⢌⢩⠒⠑⣌⢌⢍⠴⣁⡂⠎⡤⡪⡰⡁⢞....⢀⠡⡣⡩⣊⠯⡫⠗⣽⣻⣦⡘.....th
e...LSD...of...⢀⠜⠁⢐⢐⡠⡱⡱⡚⡰⢑⢭⠱⡫⣊⢥⣄⣮⠼⣒⢖⠥⠚⡦⡳⡨⠑⠚⠭⠌⢞⠂⣓⢜⠰⣈⠦⡐⣊⢒⠑⡥⣑⣷⣉⠙⣌⣾⢻⡄...f..
(QRY) Leave comment
f......⢀⡾...⡾⠾⡈⡈.⡐⡤⡱⢂⠯⠒⣉⠪⠢⡁⣄⣢⢶⣭⣾⣿⣿⢭⠟⠬⡊⢗⢗⡥⡀⣘⣨⣥⡷⣑⠵⢘⠹⣜⡥⠛⠨⣒⠥⡱⡵⠋⢍⢬⢜⠤⢉⢂⠢⡻⣬⣺⡇.
.th...⠁⢸⠋⠂.⢰⡶⣺⡊⡘⡀⠅⠎⠥⠓⠁⠁⠁⢉⢕⠕⣕⢮⣎⣏⢯⢿⣿⢷⡱⣝⣾⣾⣵⡊⢆⠑⡽⣿⡡⣃⠔⢥⠹⣒⢍⢂⢎⣢⠯⣂⢆⠿⣺⠙⡴⢀⠴⡓⠔⣝⢼⣭⣗.
he.....⣼...⣰⢍⡞⣎⡪⢒⠅⡀⠢⢄⢒⠄⢔⠠⡻⡨⠾⣚⢯⠿⣘⢥⣉⣷⣝⠮⣝⢽⠿⢶⣤⣾⣴⠾⣲⠕⡖⠕⡌⠉⠔⡕⠮⡢⡑⡭⢖⢍⡊⣾⠰⠪⠆⠅⢮⣊⢏⣷⣿.
..19...⡧...⢽⢩⢧⣫⠲⡑⡩⡊⣌.⢁⠒⡈⢑⠕⣕⠵⢓⣾⢮⢊⢞⣊⢥⣫⣿⡽⣿⣉⣬⣯⣽⣛⣿⣿⣮⢆⠧⠶⡈⢖⣽⠼⣈⠎⢒⠭⣛⢮⢾⡰⢕⠂⠠⠗⢍⢚⢮⢻.
Post categories:
(DIR) #code
990s...⡏..⠐⢸⣋⣗⣷⢑⢥⠳⣲⡒⠕⠠⠲⠠⡩⡊⠭⡙⡨⡳⣁⣵⡩⣪⣋⡿⣿⡻⣛⣷⢽⣿⣿⣿⣿⣿⣿⣵⣿⡴⡫⡚⣐⡡⣓⣔⢘⠝⣴⢯⠍⡽⣒⠅⣉⡡⠓⠈.⣸.
s.....⢀⡯⠂..⣹⡼⣱⠯⣲⢕⣙⣠⢕⢕⢐.⡪⡬⣒⢝⣾⣼⢽⣿⣿⣿⣿⣿⣿⣾⣯⣭⣾⢞⡟⣿⡻⣟⣮⣻⣿⣯⣛⢔⢕⢂⣣⣷⣿⡩⣶⢪⡛⣐⠵⢮⠂⠁⢀⠂⠈.⡿.
.PC....⡗...⠌⢿⢮⣟⣗⠯⡯⢏⡗⣽⠰.⠈.⠳⠾⢿⢿⢟⡿⢿⠿⠟⢻⢟⢟⡵⣟⢕⣥⣿⣿⢟⢟⢗⠿⡻⣺⣠⣱⢛⠟⠙⠛⠁⠉...⠈....⠠⠨⢄⢸..
...i...⢣..⠈.⠘⢿⣵⡻⣥⢟⣓⢟⠔......⠡⠈.....⠈..⠉⢂⠪⠬⢻⢶⢳⣚.⠋⠁⡉⢵⠗⠁.....⡠⢀.⠄.....⠐⡅⢿⢔⠶
is.....⠸⡀⠠ ..⣀⢄⣯.....⠁⠂⠐....⣐⢅⢠⡫⢴
..the...⣇⣺ 2017/2065 // ulcer@sdf.org ⡶⢥⣿⣿⣿⡀⠋..⣿⠢......⠮⡓⡕⣩⣾
e......⣠⣿⣿ ⡵⣴⣷⣿⣿⡷⠄⣤⠺⡑⠖⢀⢀.⡐⡔⡘⠨⡪⣲⡑⣿
.LSD...⢹⢻⣿⡯⣛⣿⣥⣿⠰⡚⡽⡭⣽⢟⣿⢚⣹⣈⢧⡷⣭⢓⡻⣿⣟⣿⣻⣢⣿⣿⡿⠋⡑⡈⡬⡳⢔⡻⡺⡁⢐⠈⣷⣾⣿⣿⣿⣟⣬⣚⢖⢬⠐⡄⠍⡤⠎⡀⠘⡰⢬⣿⣮⢿
D......⠈⣿⣿⣯⣯⣿⣿⣷⣅⢭⡻⢽⣚⣿⡾⣷⠿⣿⣿⣾⣾⢿⣿⣿⣿⡿⣟⡽⡿⣗⡱⣡⢏⣪⠮⣷⠭⣧⢗⢄⢀⠥⣎⣛⢿⡿⣷⣿⡺⡞⣏⡶⢜⣈⠴⡐⠮⠠⠈⢮⣺⣿⣿⡷
.of.....⢞⣿⢽⣿⣿⣿⣿⣿⡖⡾⣍⣞⣿⣞⣷⣿⣿⣿⣿⣿⣿⣛⣾⣊⣮⣺⣬⣽⣿⡻⣾⡾⣞⠶⣿⣽⣫⣹⠠⠐⡵⡑⣿⣽⣌⢗⠽⡼⡹⡕⣓⢮⢖⢕⠥⣊⠢⠒⣐⢕⣻⣿⢷
..the...⠘⣏⣽⣿⣿⣿⣿⣿⡏⠍⣎⢯⣫⣯⣿⣿⣿⣿⣿⣿⣯⣿⣺⣯⣿⣿⣿⣿⣿⣿⡿⢵⡹⣭⢷⣛⣟⢌⢖⡬⠐⣍⢿⣿⣿⣞⡮⣊⣾⣪⣖⣭⣒⣉⣌⢪⢐.⠕⡭⡑⣾⠲
e...19...⢻⣦⣿⣟⢿⢿⣿⣿⠅⡳⡳⢞⢯⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⠇⢚⣨⠿⣿⣾⣏⡖⣍⢊⠄⠩⣿⣿⣿⣿⣿⣯⣿⣿⣿⣿⣿⠾⣻⣐⠁⢀⢑⢅⡿⡲⢵
990s......⢷⣻⢽⢺⣿⣿⣷⡘⠌⡾⡩⣾⡽⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⡧⣀⣽⢽⣿⣿⣿⣿⣷⣿⢈⢮⠢⢈⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣳⣻⡲⢑⡈⠾⡁⣺⣧⠏
..PC......⠹⡝⠭⣾⣾⡿⣿⣧⢈⠳⣮⣻⣚⢿⡺⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⢘⡜⠙⠐⠘⠶⢻⡁⡏⠓⠁⡡⢈⡉⣿⣿⣿⣿⣿⣿⣿⣿⣿⡿⠋⠎⢖⣈⡗⡐⡒⣽⠏.
.is...th...⠙⠲⢝⠛⠿⢟⡷⡰⢘⢮⡿⣾⢶⣽⣾⣿⣿⣿⢻⣿⣿⣿⣿⣿⣿⣿⣧⡤⡼⠢..⣈⢔⢄⡤⣴⣵⡅⣴⣿⣿⣿⣿⣿⣿⣿⣿⡷⣓⠴⣐⠮⣍⡡⣱⢁⡇..
he...LSD...of...⠙⢦⢑⢅⣞⢿⢿⣾⣿⣽⣭⠷⣽⣰⣿⣿⣿⣿⣿⣿⣿⣿⠿⡢⠄.⣿⣭⣻⠽⣷⠻⣟⠎⢽⠿⣿⣿⣿⣟⣿⢿⢿⢆⣕⠴⡽⣶⣫⡩⡲⣡⡏..
f...the...1990s...⠣⢚⡔⢑⢿⣿⣾⣩⣿⣷⣿⣿⣿⣿⣿⣿⣿⡿⡿⢉⢏⠹⠠⠈⣿⡷⠤⣕⣯⡿⡫⡲...⠁⠈⠉⠒⠘⠿⢿⣳⣻⣷⠾⣭⡪⣞⢌⡇..
s....PC...is...t...⢪⠵⡁⢯⢻⡥⣿⣿⣿⣿⣿⣿⣿⣿⡿⠟.⠁..⠐⢄⢊⣾⣿⣄⡁⣭⡼⠵⡰⠐.........⢁⠻⣓⢟⣽⡸⡹⢸⠇..
the...LSD...of......⡯⡒⠵⣝⣮⢞⣽⣿⣿⣿⣿⣏⠃⠁....⠈⠠⡣⠗⡫⢛⠽⡋⢖⠕⠍⠐⢃⢆⢌⣈.......⠨⠡⣱⠿⣞⢡⠏...
.the...1990s....P...⠸⡔⢮⡪⡾⣜⣿⣿⣿⡺⣿⡌.....⢀⠐⠶⠁⣀⡠⣀⣀⡡⡀⢀⣀⣀⣬⣴⣧⡋⠆.......⠁⡽⣛⢂⠆...P
C...is...the...LSD...⠘⣦⢪⣛⡩⣿⢿⣻⡿⣩⠇.....⠨⣂⡀⡘⡛⠛⢘⢿⠻⡻⡻⣿⡿⢟⡻⣃⢄⡀⠆⡂......⡀⡱⠁...D.
..of...the...1990s....⠹⠩⢪⡲⡮⢿⣚⡯⡿⡈⠂...⢀⠨⡋⡣⠷⢵⣩⢔⡭⣰⢫⣽⣯⣶⣷⡍⡪⡑⠥⡳⡂⠠⡅..⢄⠈⡜.......
PC...is...the...LSD....⢆⠹⡪⢏⠿⣪⢗⣽⣖⢄...⢠⣅⡛⣒⠡⢑⠉⠓⠍⡖⠞⠿⠿⠻⢗⠫⠊⠚⠐⢁⠡⢌⢥⠉⡄⢁⡔......of
...the...1990s....PC....⠒⠌⠟⣖⣝⢎⣓⡿⣞⣷⣷⣼⣩⣿⣽⣾⣠⣭⡪⣠⣢⣶⠂⣂⣀⠢⠤⠄⣦⠳⢖⢔⠑⠨⢗⡘⣁⠎......is.
..the...LSD...of...the....⠑⠬⣑⠾⡪⣒⢿⣻⣿⡿⣿⣯⣿⣿⣿⣿⣿⣿⣿⣿⡱⣝⣧⡪⠴⣂⢗⠁⢕..⢁⠢⣏⡏......1990
s....PC...is...the...LSD.....⠲⢀⠁⢍⢻⢾⡳⣯⣟⣳⡭⣏⢟⠟⠟⠋⠈⠁⠈⣀⠐⠏⠏.⠃....⣨⠞.....of...t
he...1990s....PC...is...the...⠈⠁⢄⠈⠈⠩⠫⡹⠲⡸⠞......⠐⠑⠁⠈.......⠅...e...LSD..
.of...the...1990s....PC...is.....⠈⠁⢀......................⢠.....the...L
SD...of...the...1990s....PC...is...⠈⢣......................⠄...s...the.
..LSD...of...the...1990s....PC......⠐⠄....is...the...LSD...of...the...1
990s....PC...is...the...LSD...of.....⡁.....the...1990s....PC...is...the
...LSD...of...the...1990s....PC......⠆....is...the...LSD...of...the...1
990s....PC...is...the...LSD...of.....⡁.....................⠐.....the...
1990s....PC...is...the...LSD...of....⠄.....................⢀......the..
.1990s....PC...is...the...LSD...of...⢀....................⢀⠅...f...the.
..1990s....PC...is...the...LSD...of...⠆..⠠⡄...........⠠⠄⠂⠊...f...the...
1990s....PC...is...the...LSD...of.....⠈⡄..⠂.........⡠⠊.....the...1990s.
...PC...is...the...LSD...of...the...1...⢱⠈.⠑⠐⠐⠂⠂⢒⠒.⠊...1990s....PC...is
(DIR) BREAKING NEWS -- special pages
(DIR) change layout -- root
Page views: 12