Answer by Kwebble for rss to sql using magpie and cron job
Links may not be the enough because articles are duplicated on several sites. I once made a system to collect articles from a lot of newspapers where the same article can appear in multiple sources....
View ArticleAnswer by Tech163 for rss to sql using magpie and cron job
Since you are worried about duplication issues, how is it even going to end up duplicated? If it's found on several different sites, I suppose it's better idea to find MD5 of first sentence of the...
View Articlerss to sql using magpie and cron job
Basically, i want my site to aggregate a lot of rss feeds and store them in database during cron job. i use magpie to parse the rss into arrays...everything should seem straight forward although im...
View Article
