Posted by Philipp Lenssen on 02/24/07 20:03

Hi! I'm having some problems correctly screenscraping and outputting
e.g. Chinese characters from a Google translator search result. The
output is always a garbled mess, not Chinese characters. German for
instance works fine. Thanks for any hints...!!


Some relevant parts from the PHP5:
/******************/

header ('Content-type: text/html; charset=utf-8');
....
showResult( getTranslation('bird flu', 'zh-CN'), 'Chinese' );
....


function getTranslation($q, $lang)
{
$out = '';
// the Google page is supposed to be UTF-8 too:
$in = getFileText( "http://google.com/translate_t?langpair=en|" .
urlencode($lang) . "&text=".urlencode($q) );
preg_match('/<div id=result_box dir=ltr>(.*?)<\/div>/', $in,
$out);

$translation = $out[1]; // garbled!
$translation = trim($translation);
$translation = utf8_encode($translation); // garbled with or
without this line...
return $translation;
}

/******************/

• Next in forum: Re: best xml parser for php?
• Prev in forum: Re: Trying to prevent duplicates in preg_replace Regex
• Thread view: Screenscraping UTF-8 characters problem

[Reply to this message]