Reading remote files
This is a discussion on Reading remote files within the alt.comp.lang.php forums, part of the PHP Programming Forums category; I'm attempting to read a remote file and parse it for data. The problem I'm having is that ...
|
|||||||
| FAQ | Members List | Calendar | Search | Today's Posts | Mark Forums Read |
08-11-2003
|
|||
|
|||
Reading remote files
I'm attempting to read a remote file and parse it for data. The problem I'm
having is that the file seems to be generated by Perl (http://alert.dot.pima.gov/scripts/1brpssd.pl) and when I read it the script-generated data is not displayed. When I view the page with a browser the data is displayed just fine. I've tried using the built-in PHP commands to read the file (file, fget) as well as the all of the Snoopy "fetch" classes (http://snoopy.sourceforge.net). Any ideas? Thanks. M 
|
|
08-12-2003
|
|||
|
|||
|
Re: Reading remote files
"Matt Daleo" <azdaleo@yahoo.com> wrote in message
news:<_CSZa.6945$M6.533042@newsread1.prod.itd.eart hlink.net>... > > I'm attempting to read a remote file and parse it for data. The problem > I'm having is that the file seems to be generated by Perl > (http://alert.dot.pima.gov/scripts/1brpssd.pl) and when I read it the > script-generated data is not displayed. When I view the page with a browser > the data is displayed just fine. I've tried using the built-in PHP commands > to read the file (file, fget) as well as the all of the Snoopy "fetch" > classes (http://snoopy.sourceforge.net). Any ideas? Try this: $host = 'alert.dot.pima.gov'; $path = '/scripts/1brpssd.pl'; $fp = fsockopen ($host, '80'); if ($fp) { fputs ($fp, 'GET '.$path." HTTP/1.0\r\nHost: ".$host."\r\n\r\n"); while (!feof($fp)) { echo fgets ($fp, 10240); } } else { echo "Oops... Didn't work... "; } Cheers, NC
|
|
08-12-2003
|
|||
|
|||
|
Re: Reading remote files
Is there anyway to get the script to not display the header/get information?
ie: HTTP/1.1 200 OK Date: Tue, 12 Aug 2003 03:31:17 GMT Server: Apache/2.0.40 (Red Hat Linux) Accept-Ranges: bytes X-Powered-By: PHP/4.2.2 Content-Length: 111 Connection: close Content-Type: text/html; charset=ISO-8859-1 And just display the content of the page? Your script works perfect for my application, I would just like to figure out how to remove the http information. Thanks- "Nikolai Chuvakhin" <nc@iname.com> wrote in message news:32d7a63c.0308111850.642448e8@posting.google.c om... > "Matt Daleo" <azdaleo@yahoo.com> wrote in message > news:<_CSZa.6945$M6.533042@newsread1.prod.itd.eart hlink.net>... > > > > I'm attempting to read a remote file and parse it for data. The problem > > I'm having is that the file seems to be generated by Perl > > (http://alert.dot.pima.gov/scripts/1brpssd.pl) and when I read it the > > script-generated data is not displayed. When I view the page with a browser > > the data is displayed just fine. I've tried using the built-in PHP commands > > to read the file (file, fget) as well as the all of the Snoopy "fetch" > > classes (http://snoopy.sourceforge.net). Any ideas? > > Try this: > > $host = 'alert.dot.pima.gov'; > $path = '/scripts/1brpssd.pl'; > $fp = fsockopen ($host, '80'); > if ($fp) { > fputs ($fp, 'GET '.$path." HTTP/1.0\r\nHost: ".$host."\r\n\r\n"); > while (!feof($fp)) { > echo fgets ($fp, 10240); > } > } else { > echo "Oops... Didn't work... "; > } > > Cheers, > NC
|
|
08-12-2003
|
|||
|
|||
|
Re: Reading remote files
Thanks for the script. I've tried it and it works great with other web
pages, but still doesn't seem to work with the particular page that I need. When I run the script this is the output that I get. I need the missing data within the <textarea> tags: HTTP/1.1 200 OK Server: Microsoft-IIS/5.0 Date: Tue, 12 Aug 2003 04:24:15 GMT Content-Type: text/html <html> <head> <title>Map 1 Upper Caņada del Oro sensors</title> </head> <body> <body background=/DWGraphics/DWBG.jpg> <div align=Center><font size=+2 color=#551a8b><big><big><big><big><big><big><big>< big><big><big><big><big><b ig><big><big> Map 1 Upper Caņada del Oro Sensors</big></big></big></big></big></big></big></big></big></big></big></b ig></big></big></big></font><br> </div>     <div align=Center><font size=5 color=#551a8b> Hourly Rainfall for 0 Periods For Sensors In Map 1 Upper Caņada del Oro </font><br> </dev> <td> <FORM METHOD=POST> <TEXTAREA NAME=Data ROWS=25 COLS=100 WRAP=OFF READONLY> </TEXTAREA> </FORM> </body> <center> <a href=Pima.pl><b><font size=4>Main Map</font></b></a>       <a href=2brpssd.pl><b><font size=4>Map 2</font></b></a>       <a href=3brpssd.pl><b><font size=4>Map 3</font></b></a>       <a href=4brpssd.pl><b><font size=4>Map 4</font></b></a>       <a href=5brpssd.pl><b><font size=4>Map 5</font></b></a> </center> </html> Thanks. M "Nikolai Chuvakhin" <nc@iname.com> wrote in message news:32d7a63c.0308111850.642448e8@posting.google.c om... > "Matt Daleo" <azdaleo@yahoo.com> wrote in message > news:<_CSZa.6945$M6.533042@newsread1.prod.itd.eart hlink.net>... > > > > I'm attempting to read a remote file and parse it for data. The problem > > I'm having is that the file seems to be generated by Perl > > (http://alert.dot.pima.gov/scripts/1brpssd.pl) and when I read it the > > script-generated data is not displayed. When I view the page with a browser > > the data is displayed just fine. I've tried using the built-in PHP commands > > to read the file (file, fget) as well as the all of the Snoopy "fetch" > > classes (http://snoopy.sourceforge.net). Any ideas? > > Try this: > > $host = 'alert.dot.pima.gov'; > $path = '/scripts/1brpssd.pl'; > $fp = fsockopen ($host, '80'); > if ($fp) { > fputs ($fp, 'GET '.$path." HTTP/1.0\r\nHost: ".$host."\r\n\r\n"); > while (!feof($fp)) { > echo fgets ($fp, 10240); > } > } else { > echo "Oops... Didn't work... "; > } > > Cheers, > NC >
|
|
08-12-2003
|
|||
|
|||
|
Re: Reading remote files
"Matt Daleo" <azdaleo@yahoo.com> wrote in message
news:<C%ZZa.8128$M6.617108@newsread1.prod.itd.eart hlink.net>... > > Thanks for the script. I've tried it and it works great with other web > pages, but still doesn't seem to work with the particular page that I need. > When I run the script this is the output that I get. I need the missing data > within the <textarea> tags: I just opened the URL you are trying to retrieve in browser and reloaded it several times. There is no data in <textarea>... Cheers, NC
|
|
08-12-2003
|
|||
|
|||
|
Re: Reading remote files
You're right. When you go directly to the page there is no data, but if you
go in through the main page and navigate to it the data is there. Is there a way to check the headers to see if it's passing session variables? Or is it another issue? Thanks. M "Nikolai Chuvakhin" <nc@iname.com> wrote in message news:32d7a63c.0308121137.6a83605@posting.google.co m... > "Matt Daleo" <azdaleo@yahoo.com> wrote in message > news:<C%ZZa.8128$M6.617108@newsread1.prod.itd.eart hlink.net>... > > > > Thanks for the script. I've tried it and it works great with other web > > pages, but still doesn't seem to work with the particular page that I need. > > When I run the script this is the output that I get. I need the missing data > > within the <textarea> tags: > > I just opened the URL you are trying to retrieve in browser and reloaded > it several times. There is no data in <textarea>... > > Cheers, > NC >
|
|
08-13-2003
|
|||
|
|||
|
Re: Reading remote files
"Matt Daleo" <azdaleo@yahoo.com> wrote in message
news:<%Ic_a.9224$M6.756854@newsread1.prod.itd.eart hlink.net>... > > > > When I run the script this is the output that I get. I need > > > the missing data within the <textarea> tags: > > > > I just opened the URL you are trying to retrieve in browser and reloaded > > it several times. There is no data in <textarea>... > > You're right. When you go directly to the page there is no data, but if you > go in through the main page and navigate to it the data is there. Is there a > way to check the headers to see if it's passing session variables? Or is it > another issue? Most likely (just by the looks of it), the Perl scripts set cookies. You can deal with this system using cURL, but you will have to program cURL to more or less precisely imitate the sequence of page loads you accomplish with your browser. Cheers, NC
|
|
08-13-2003
|
|||
|
|||
|
Re: Reading remote files
"Matt Daleo" <azdaleo@yahoo.com> wrote in message
news:<jxe_a.9443$M6.775682@newsread1.prod.itd.eart hlink.net>... > > I've figured it out. The HTML headers need to read as follows: > > GET /scripts/1brpssd.pl HTTP/1.1 Host: alert.dot.pima.gov > Cookie: pimafile=-Inetpub-Scripts-DWTemp-config1060728166.txt > > It looks to me like they're using a cookie to activate a script > of some kind. I don't think so. Rather, the cookie contains a reference to a data file, which the script retrieves and displays. Cheers, NC
|
Linear Mode
