In this post, i’m going to write a simple explanation / basic example about using Yahoo Pipes to fetch a webpage (you are free to use any pages you want assuming they allow Yahoo Pipes) and then create a RSS Feed from it so you can read it on your favorite rss reader
Before anything else, please see the source of the pipe used in this example (you need to log in to Yahoo first) because the screenshots used in this example is not a screenshot of the pipe itself but from the output debugger because the process itself is simple. And with that said, here are the description on each processUpdate: Here’s the updated version of the pipe which is used for their new domain(horriblesubs.info) and their new site design. The old pipe is left there in case you want to compare the old pipe with the updated pipe. And as you can see by yourself, the process itself is still the same as before but with some adjustments.Update 2: As of June 2012 (last time i checked their website because ever since Gintama ends, i don’t check it anymore) it is still working, and i noticed that they now published their own RSS Feed so if you only use this simple example to fetch their rss feed, i recommend to grab their official feed instead because i saw on their page that they’re planning on redesigning their website1. First thing you need to do is obviously examine the page source you’re going to fetch to see where you should start cutting and how the items separatedFor example, in this case the content i’m going to pick is wrapped within a div ( <div id="tab3" class="boxcontent"> ) and the items is separated by <br/> tag. And so i just need to write that into the fetch page module
When you’re done with this step, the rest (perhaps) can be considered as cosmetic because you can use it without doing the rest but while at it, i might as well make it pretty even i’m the only person that use it2. At this part, i’m filtering the content from unneded html tags and content that i deemed unnecessary by using the regex / regular expression module as you can see on the pipe source. But because there’s no single regex rule to rule them all (because it depends on your needs), you’ll need to experiment by yourself at the regex parts3. And now, so i can process each item separately, i’m mapping the previously cleaned up content as title, description, and link which is going to be used for the RSS Feed title, description and link respectively by using the rename module so the output look like below image
4. Once again the regex module is used and this time i’m using it to clean-up the html tags in the title (to differentiate it from the description) and the link so it gives you the target url only (in this case it is the torrent link) so when you click on the title from your RSS Reader you’ll go to the target url directly (note: see the output difference between below output image and the above image)
5. Finally connect it to the pipe output and to get it as RSS, you just need to copy the Get as RSSlink from your pipe to display it as RSS Feed and done
Also because there’s a usage limits imposed by Yahoo Pipes as quoted below200 runs (of a given Pipe) in 10 minutes
200 runs (of any Pipe) from an IP in 10 minutes
If you exceed the 200 runs in a 10 minute block, your Pipe will be 999′ed for a hour.
You should make sure to cache your output before using it (unless perhaps you’re the only person that use the pipe you’ve created though it’s still better to cache it)
Before anything else, please see the source of the pipe used in this example (you need to log in to Yahoo first) because the screenshots used in this example is not a screenshot of the pipe itself but from the output debugger because the process itself is simple. And with that said, here are the description on each process
Update: Here’s the updated version of the pipe which is used for their new domain(horriblesubs.info) and their new site design. The old pipe is left there in case you want to compare the old pipe with the updated pipe. And as you can see by yourself, the process itself is still the same as before but with some adjustments.
Update 2: As of June 2012 (last time i checked their website because ever since Gintama ends, i don’t check it anymore) it is still working, and i noticed that they now published their own RSS Feed so if you only use this simple example to fetch their rss feed, i recommend to grab their official feed instead because i saw on their page that they’re planning on redesigning their website
1. First thing you need to do is obviously examine the page source you’re going to fetch to see where you should start cutting and how the items separated
For example, in this case the content i’m going to pick is wrapped within a div ( <div id="tab3" class="boxcontent"> ) and the items is separated by <br/> tag. And so i just need to write that into the fetch page module
When you’re done with this step, the rest (perhaps) can be considered as cosmetic because you can use it without doing the rest but while at it, i might as well make it pretty even i’m the only person that use it
2. At this part, i’m filtering the content from unneded html tags and content that i deemed unnecessary by using the regex / regular expression module as you can see on the pipe source. But because there’s no single regex rule to rule them all (because it depends on your needs), you’ll need to experiment by yourself at the regex parts
3. And now, so i can process each item separately, i’m mapping the previously cleaned up content as title, description, and link which is going to be used for the RSS Feed title, description and link respectively by using the rename module so the output look like below image
4. Once again the regex module is used and this time i’m using it to clean-up the html tags in the title (to differentiate it from the description) and the link so it gives you the target url only (in this case it is the torrent link) so when you click on the title from your RSS Reader you’ll go to the target url directly (note: see the output difference between below output image and the above image)
5. Finally connect it to the pipe output and to get it as RSS, you just need to copy the Get as RSSlink from your pipe to display it as RSS Feed and done
Also because there’s a usage limits imposed by Yahoo Pipes as quoted below
200 runs (of a given Pipe) in 10 minutes
200 runs (of any Pipe) from an IP in 10 minutes
If you exceed the 200 runs in a 10 minute block, your Pipe will be 999′ed for a hour.
You should make sure to cache your output before using it (unless perhaps you’re the only person that use the pipe you’ve created though it’s still better to cache it)
make sure man,that the sites are sertified and it's terms and conditions.
coz we dont wanna make any trouble.! that'all.
the above codes are not violating any of the terms and conditions
that for the secure of the internet users.
so please go on!.
no video for this stuff
