Curl getting html tags

aliahsan81 · 07-30-2009, 06:01 AM

I am making a script in which i wana use curl to download a web page and check status.But problem is when i use curl in linux command line it downlaod htlm tags.How can we ignore these tage any idea.

JulianTosh · 07-30-2009, 06:09 AM

You can use the -I option to only retrieve headers and page status. For example:

Code:

$ curl -I http://www.google.com
HTTP/1.1 200 OK
Date: Thu, 30 Jul 2009 11:08:36 GMT
Expires: -1
Cache-Control: private, max-age=0
Content-Type: text/html; charset=ISO-8859-1
Server: gws
Transfer-Encoding: chunked

$

aliahsan81 · 07-30-2009, 06:15 AM

Thanks for quick reply.

I want to get page content to parse in my script.

JulianTosh · 07-30-2009, 06:22 AM

Can you post an example of what content you're retreiving and specifically what content you wish to extract from it?

aliahsan81 · 07-30-2009, 06:26 AM

yes sure i am getting my page that will check server status either good or bad.

text is some think like this

Server response is OK

Or

server sending error xxx

JulianTosh · 07-30-2009, 06:32 AM

It's probably easiest to grep for the affirmative and error on anything else..

Code:

curl http://example.com |  grep -i "Server response is OK"
if [ $? == 0 ]
then
  echo "Everything's OK"
else
  echo "Get me a hammer."
fi

aliahsan81 · 07-30-2009, 06:47 AM

ok,That i have already done it.

.So it mean there is not way to achieve what i have asked,I have asked this question because like browser didnt show up html.So i tough same curl will do.Any way thanks for your help:

speccy · 07-30-2009, 08:09 AM

If you are trying to get just the page content (without tags) try:

Code:

lynx -dump http://www.example.com

aliahsan81 · 07-31-2009, 09:02 AM

yes thanks i am using elinks