Difference between revisions of "Files/FileNamesUTF8"

From EPrints Documentation
Jump to: navigation, search
m (Reverted edit of WikiSysop, changed back to last version by Sx8Nko)
Line 1: Line 1:
[http://maheinze.airsofthost.com/data/fal.htm fal] [http://maheinze.airsofthost.com/data/blod-honor.htm blod honor] [http://tracklist-hit.firethro.info tracklist hit mania dance estate 2004] [http://alpaddy.airsofthost.com/img/styles/air-max/ air max nero rosso] [http://cartoline-sexsy.firethro.info cartoline sexsy] [http://fiat-stilo.otrev4ro.info fiat stilo mw] [http://lejenny.airsofthost.com/library/html/kayleigh.htm kayleigh] [http://alpaddy.airsofthost.com/img/styles/ally-mc/ ally mc beal] [http://remayfuy.airsofthost.com/images/small/la-battaglia/ la battaglia di stalingrado] [http://frgrossm.airsofthost.com/topic/erboristerie-online/ erboristerie online] [http://hdurian.airsofthost.com/view/new/mesager.htm mesager] [http://hdurian.airsofthost.com/view/new/dolby-system.htm dolby system] [http://banzlees.airsofthost.com/description/lib/cicciolina-mp.htm cicciolina mp4] [http://tutti-giu.otrev4ro.info tutti giu per terra giuseppe culicchia] [http://splucind.airsofthost.com/content/view/azione-matrix/ azione matrix] [http://banzlees.airsofthost.com/description/lib/little-models.htm little models] [http://ristoranti-etnici.otrev4ro.info ristoranti etnici] [http://frgrossm.airsofthost.com/topic/dance-news/ dance news vol 7] [http://laortiz.airsofthost.com/view/new/celeb-scandalo/ celeb scandalo] [http://yamaha-lettore.otrev4ro.info yamaha lettore cd] [http://banzlees.airsofthost.com/description/lib/vedda.htm vedda] [http://i-had.otrev4ro.info i had the time of my life] [http://al-hs.cleric4u.info al 1722hs] [http://alpaddy.airsofthost.com/img/styles/bacon-fils/ bacon fils] [http://caetano.cleric4u.info caetano] [http://tragico-oriente.otrev4ro.info tragico oriente] [http://remayfuy.airsofthost.com/images/small/albergo-roma/ albergo roma centro] [http://tony-tammaro.firethro.info tony tammaro] [http://splucind.airsofthost.com/content/view/canon-mf/ canon mf 5650] [http://hdurian.airsofthost.com/view/new/i-divertimenti.htm i divertimenti della vita privata] [http://banzlees.airsofthost.com/description/lib/power-translator.htm power translator pro 9 0] [http://remayfuy.airsofthost.com/images/small/stampa-volantini/ stampa volantini] [http://hp.firethro.info hp 5110] [http://oostvlaanderen.firethro.info oostvlaanderen] [http://maheinze.airsofthost.com/data/biglietto-aereo.htm biglietto aereo scontato] [http://frgrossm.airsofthost.com/topic/foto-automobili/ foto automobili] [http://champion-league.cleric4u.info champion league tv] [http://le-piu.cleric4u.info le piu belle donne] [http://tarantella-italiana.giantlau.info tarantella italiana] [http://splucind.airsofthost.com/content/view/giacca-uomo/ giacca uomo abbigliamento] [http://rumote.airsofthost.com/lib/hd-.htm hd 300 gb eide 7200rpm diamondmax 10] [http://immagini-elisa.cleric4u.info immagini elisa triani] [http://daddy-cool.cleric4u.info daddy cool] [http://football-australiano.giantlau.info football australiano] [http://cd-video.firethro.info cd video cd mp3] [http://laortiz.airsofthost.com/view/new/i-dont/ i dont wonna now] [http://remayfuy.airsofthost.com/images/small/hp-/ hp 7450 photosmart] [http://maheinze.airsofthost.com/data/cavallo-verona.htm cavallo verona] [http://maheinze.airsofthost.com/data/muvo-v.htm muvo v200 512 mb] [http://yamaha-dvds.monbrenno.info yamaha dvds550] [http://fotocamere-digitali.firethro.info fotocamere digitali yakumo] [http://hdurian.airsofthost.com/view/new/bebe-confort.htm bebe confort allegro plus] [http://ken-il.cleric4u.info ken il guerriero dvd] [http://frgrossm.airsofthost.com/topic/garda-lavoro/ garda lavoro] [http://lejenny.airsofthost.com/library/html/forno-microonde.htm forno microonde samsung 37 litri] [http://samsung-.firethro.info samsung 710 tv 17] [http://casio-exilim.firethro.info casio exilim pro p700] [http://hp-laserjet.firethro.info hp laserjet 4650dn] [http://frgrossm.airsofthost.com/topic/biglietto-augurio/ biglietto augurio nascita] [http://nangarhar.cleric4u.info nangarhar] [http://splucind.airsofthost.com/content/view/vintage-ma/ vintage ma non] [http://remayfuy.airsofthost.com/images/small/dragonera/ dragonera] [http://rumote.airsofthost.com/lib/teac-.htm teac 250 gb] [http://volo-follonica.cleric4u.info volo follonica] [http://splucind.airsofthost.com/content/view/poesia-dediche/ poesia dediche] [http://foppapedretti-stendi.otrev4ro.info foppapedretti stendi] [http://maheinze.airsofthost.com/data/philips-televisore.htm philips televisore 28] [http://time-stood.firethro.info time stood still] [http://frgrossm.airsofthost.com/topic/ragazze-grasse/ ragazze grasse] [http://familia-lima.firethro.info familia lima] [http://lettini-per.monbrenno.info lettini per neonati] [http://frgrossm.airsofthost.com/topic/hp-t/ hp t3010] [http://splucind.airsofthost.com/content/view/supporto-pda/ supporto pda qtek per auto] [http://leggiposta.cleric4u.info leggiposta] [http://remayfuy.airsofthost.com/images/small/bolero-extasy/ bolero extasy] [http://profumi-hermes.giantlau.info profumi hermes jardin] [http://lejenny.airsofthost.com/library/html/dynamite-ducks.htm dynamite ducks] [http://maheinze.airsofthost.com/data/fausto-e.htm fausto e anna di cassola] [http://hdurian.airsofthost.com/view/new/la-vita.htm la vita oltre la vita] [http://splucind.airsofthost.com/content/view/banff-shopping/ banff shopping] [http://viva-gaggia.cleric4u.info viva gaggia] [http://un-amore.firethro.info un amore impossibile dei tiro mancino] [http://hdurian.airsofthost.com/view/new/intel-xe.htm intel 925xe] [http://splucind.airsofthost.com/content/view/reggio-calabria/ reggio calabria] [http://banzlees.airsofthost.com/description/lib/iatliani-piu.htm iatliani piu famosi] [http://tuta-roma.firethro.info tuta roma] [http://laortiz.airsofthost.com/view/new/villaverde/ villaverde] [http://pneumotorace.otrev4ro.info pneumotorace] [http://lejenny.airsofthost.com/library/html/frigoriferi-a.htm frigoriferi a compressore] [http://vacuum-tube.cleric4u.info vacuum tube] [http://laortiz.airsofthost.com/view/new/unefon/ unefon] [http://audigy-zs.otrev4ro.info audigy2 zs] [http://frgrossm.airsofthost.com/topic/testi-di/ testi di pink] [http://traduttore-di.cleric4u.info traduttore di testi spagnoli] [http://una-casa.cleric4u.info una casa in via del campo] [http://ramazzotti-pietra.firethro.info ramazzotti pietra tabs] [http://nike-nz.firethro.info nike nz] [http://bassi-acustici.monbrenno.info bassi acustici] [http://frgrossm.airsofthost.com/topic/adidas-team/ adidas team] [http://ragazzo-taormina.otrev4ro.info ragazzo taormina] [http://allestimento-mostre.otrev4ro.info allestimento mostre] [http://fr.monbrenno.info fr 540] [http://sborrami-in.firethro.info sborrami in bocca] [http://calendario-capital.firethro.info calendario capital] [http://case-in.monbrenno.info case in costruzione] [http://lejenny.airsofthost.com/library/html/peugeot-.htm peugeot 406 sw hdi] [http://cardito.otrev4ro.info cardito] [http://splucind.airsofthost.com/content/view/massaggiatrici-lecce/ massaggiatrici lecce] [http://libro-dei.firethro.info libro dei protesti] [http://lcd-b.firethro.info lcd b o 32] [http://tampa-san.monbrenno.info tampa san petersburg cose fare] [http://maglioni-liu.giantlau.info maglioni liu jo] [http://laortiz.airsofthost.com/view/new/fp/ fp 940] [http://vannucci-atto.cleric4u.info vannucci atto] [http://frigorifero-.cleric4u.info frigorifero 188 cm] [http://lejenny.airsofthost.com/library/html/bedandbreakfast-sardegna.htm bedandbreakfast sardegna] [http://sverginata.giantlau.info sverginata] [http://hdurian.airsofthost.com/view/new/concerti-.htm concerti 2004 raf] [http://remayfuy.airsofthost.com/images/small/qosmio-double/ qosmio double layer toshiba portatili] [http://dect-gap.monbrenno.info dect gap telecom] [http://venire-dentro.otrev4ro.info venire dentro] [http://gloria-cacharel.monbrenno.info gloria cacharel] [http://maheinze.airsofthost.com/data/sony-.htm sony  dcr dvd403e] [http://centro-commerciale.monbrenno.info centro commerciale i portali] [http://hdurian.airsofthost.com/view/new/unipd.htm unipd] [http://latino-americano.firethro.info latino americano carnival] [http://ragazze-di.firethro.info ragazze di napoli] [http://d-p.monbrenno.info d p r 459 96] [http://angel-devil.monbrenno.info angel devil] [http://splucind.airsofthost.com/content/view/totocalcio/ totocalcio 2004] [http://laortiz.airsofthost.com/view/new/sms-it/ sms it] [http://gabbiano-infelice.otrev4ro.info gabbiano infelice] [http://laortiz.airsofthost.com/view/new/per-amore/ per amore per magia] [http://salone-francesca.otrev4ro.info salone francesca] [http://rumote.airsofthost.com/lib/statistica-sito.htm statistica sito web] [http://foto-amatoriali.giantlau.info foto amatoriali di donne spogliate] [http://come-un.monbrenno.info come un gelato all equatore] [http://filmato-bulgari.cleric4u.info filmato bulgari conte] [http://splucind.airsofthost.com/content/view/mp-cem/ mp3 cem karaca] [http://remayfuy.airsofthost.com/images/small/download-nero/ download nero6 retail] [http://lionel-richi.firethro.info lionel richi] [http://ml-oki.otrev4ro.info ml oki stampanti] [http://frgrossm.airsofthost.com/topic/eva-hanger/ eva hanger] [http://maheinze.airsofthost.com/data/video-player.htm video player] [http://alpaddy.airsofthost.com/img/styles/staffa-a/ staffa a muro universale] [http://accessori-mio.giantlau.info accessori mio 168] [http://on-regionale.giantlau.info on regionale amendola] [http://frgrossm.airsofthost.com/topic/il-billiardo/ il billiardo] [http://nokia-.monbrenno.info nokia 6230 live] [http://remayfuy.airsofthost.com/images/small/handycam-dcrhce/ handycam dcrhc17e] [http://false-bay.monbrenno.info false bay] [http://hdurian.airsofthost.com/view/new/pioneer-dcs.htm pioneer dcs 525] [http://lejenny.airsofthost.com/library/html/laws-on.htm laws on spy cams] [http://banzlees.airsofthost.com/description/lib/geforce-.htm geforce 6600 128 mb] [http://sms-gratuiti.firethro.info sms gratuiti cellulare] [http://laortiz.airsofthost.com/view/new/cabernet-sauvignon/ cabernet sauvignon emilia] [http://connerie.giantlau.info connerie] [http://csi-vicenza.firethro.info csi vicenza] [http://hdurian.airsofthost.com/view/new/benvenuti.htm benvenuti] [http://nuova-carens.monbrenno.info nuova carens kia] [http://hard-usb.firethro.info hard usb2] [http://splucind.airsofthost.com/content/view/dispositivo-gps/ dispositivo gps] [http://xxxporn.monbrenno.info xxxporn] [http://rumote.airsofthost.com/lib/fotos-karen.htm fotos karen dejo] [http://bl-c.monbrenno.info bl 4c] [http://hdurian.airsofthost.com/view/new/heidi-novgorod.htm heidi novgorod] [http://traduzione-shut.firethro.info traduzione shut up] [http://splucind.airsofthost.com/content/view/nuovi-giochi/ nuovi giochi da non scaricare e non con] [http://laortiz.airsofthost.com/view/new/kodak-easyshare/ kodak easyshare cx7525 7525] [http://test-d.firethro.info test d ingresso scuola media inferiore] [http://remayfuy.airsofthost.com/images/small/macgyver/ macgyver] [http://maheinze.airsofthost.com/data/finestre.htm finestre] [http://alpaddy.airsofthost.com/img/styles/chris-benoit/ chris benoit] [http://frgrossm.airsofthost.com/topic/testi-canzoni/ testi canzoni hilary duff] [http://rumote.airsofthost.com/lib/tv-plasma.htm tv plasma wxga] [http://laortiz.airsofthost.com/view/new/dj-raff/ dj raff] [http://frgrossm.airsofthost.com/topic/riassunto-giara/ riassunto giara pirandello] [http://splucind.airsofthost.com/content/view/renault-megane/ renault megane 1 5 luxe dinamique] [http://frisina.cleric4u.info frisina] [http://computorgirl.giantlau.info computorgirl] [http://banzlees.airsofthost.com/description/lib/dvd-r.htm dvd r70 philips] [http://frgrossm.airsofthost.com/topic/alcatel-all/ alcatel all be4] [http://laortiz.airsofthost.com/view/new/donne-proibite/ donne proibite] [http://alpaddy.airsofthost.com/img/styles/destroy-all/ destroy all humans game] [http://telecamera-sony.otrev4ro.info telecamera sony pc 6] [http://remayfuy.airsofthost.com/images/small/foppapedretti-fasciatoi/ foppapedretti fasciatoi] [http://felicity-huffman.monbrenno.info felicity huffman] [http://alpaddy.airsofthost.com/img/styles/traduzione-in/ traduzione in cinese] [http://rumote.airsofthost.com/lib/portoferraio.htm portoferraio] [http://frgrossm.airsofthost.com/topic/video-porno/ video porno da vedere gratuitamente] [http://lavatrici-carica.giantlau.info lavatrici carica alto profondita 40] [http://e-non.firethro.info e non ho te] [http://lejenny.airsofthost.com/library/html/grand-hotel.htm grand hotel olympic aurum] [http://frgrossm.airsofthost.com/topic/uno-strano/ uno strano percorso 883] [http://laortiz.airsofthost.com/view/new/lady-susan/ lady susan] [http://immagini-cbr.giantlau.info immagini cbr] [http://grl.cleric4u.info grl] [http://frgrossm.airsofthost.com/topic/assistenza-tecnica/ assistenza tecnica acer bari] [http://sabarkantha.firethro.info sabarkantha] [http://adamo-giovanni.firethro.info adamo giovanni] == Hack to have file names with utf-8 chars (for browsing) ==
+
== Hack to have file names with utf-8 chars (for browsing) ==
 
All start with  a problem about browsing and UFT-8.
 
All start with  a problem about browsing and UFT-8.
 
I have done a browsing index on journal titles (as for example 'Library Tech News', ' Library tech', ec.).
 
I have done a browsing index on journal titles (as for example 'Library Tech News', ' Library tech', ec.).
Line 28: Line 28:
 
You must have a file system that support UTF-8 in file names (like ext3).
 
You must have a file system that support UTF-8 in file names (like ext3).
  
The result (a journal in greek): http://eprints.rclis.org/view/journtitle/Τεκμήριον.html
+
The result (a journal in greek): http://eprints.rclis.org/view/journtitle/%CE%A4%CE%B5%CE%BA%CE%BC%CE%AE%CF%81%CE%B9%CE%BF%CE%BD.html
 
The link is written with hex values, but on the file system the name is with greek chars.
 
The link is written with hex values, but on the file system the name is with greek chars.

Revision as of 11:22, 3 September 2007

Hack to have file names with utf-8 chars (for browsing)

All start with a problem about browsing and UFT-8. I have done a browsing index on journal titles (as for example 'Library Tech News', ' Library tech', ec.). The name of the field where uploader inserts the journal title is 'pubblication'.


The browsing index is done of static web pages, there is menu page with all journal titles and links to pages of every journal. The name of the web page of one jornal is <journal title>.html For example: http://eprints.rclis.org/view/journtitle/Biology_Education.html The name of the file in the file system is Biology_Education.html


But what happens when you have journal title with name not in latin chars ? Reading RFC 1738 is clear that web link must be only with US-ASCII chars, so EPrints transalte the US-ASCII chars in numeric, using the numbers of UTF-8. For example: http://eprints.rclis.org/view/journtitle/==6D25==56FE==5B66==520A.html ( a chinese journal). But this translation uses many chars, 6 chars for every sign not US-ASCII. In Linux, with file system ext3 the file name could be at max 255 byte long. I can index only jornal titles with a t max 42 signs, too few.


The problem is present in the line 484 of generate_views:

       print FILE EPrints::XML::to_string( $page, undef, 1 );

So the solution (the idea came from Chris) is to hack the routine that manages the name of files. The routine is escape_filename in EPrints::Utils.pm.

From http://eprints.rclis.org/fixsoft/Utils.pm.gz you can download the routine hacked by me. Please be careful, it is a huge change. You must to rebuilt all files with generate_abstrat, generate_views, generate_static (after a stop and restart of Apache). You must have a file system that support UTF-8 in file names (like ext3).

The result (a journal in greek): http://eprints.rclis.org/view/journtitle/%CE%A4%CE%B5%CE%BA%CE%BC%CE%AE%CF%81%CE%B9%CE%BF%CE%BD.html The link is written with hex values, but on the file system the name is with greek chars.