Jump to content
ryan

Load RSS Feeds (MarkupLoadRSS)

Recommended Posts

The error says that $rss is not an object, so the call $modules->get doesn't return a module instance. Did you install the module after downloading it?

Yes it's installed :

Title 	Markup RSS Feed
Class 	MarkupRSS
File 	/wire /modules /Markup /MarkupRSS.module
ID 	171
Version 	1.0.2
Installed 	1 hour ago
Summary 	Renders an RSS feed. Given a PageArray, renders an RSS feed of them.

Share this post


Link to post
Share on other sites

Seems you got your modules confused :-)

  1. This is the module you want: https://github.com/ryancramerdesign/MarkupLoadRSS. MarkupLoadRSS: It reads feeds. http://mods.pw/W
  2. What you have above (part of the core) is: Markup RSS Feed. It generates feeds.

Install #1 and you should be fine. I tested your code and it works.

Edited by kongondo
  • Like 2

Share this post


Link to post
Share on other sites

Seems you got your modules confused :-)

  1. This is the module you want: https://github.com/ryancramerdesign/MarkupLoadRSS. MarkupLoadRSS: It reads feeds. http://mods.pw/W
  2. What you have above (part of the core) is: Markup RSS Feed. It generates feeds.

Install #1 and you should be fine. I tested your code and it works.

Oh my....

Installed 4 seconds ago

Thank you very much.

Share this post


Link to post
Share on other sites

Hi there,

is the modification developed by apeisa (support for multiple feeds) already implemented in this module or should I customize some files?

Share this post


Link to post
Share on other sites

@Marco -

i believe that MarkupRSSEnhanced module does multiple feeds;

i do something like this on my template where i need the feed:

/* FEED GLOBAL SETTINGS
-------------------------------------*/
$rssTitle = isset($rss_title) ? $rss_title : '9th Planet Blog';
$rssDesc  = isset($rss_description) ? $rss_description : 'Official blog of the 9th Planet';
$limit 	  = isset($rss_limit) ? $rss_limit : 10;

/* RSS
-------------------------------------*/
if($input->urlSegment1 == 'rss.xml') {

	$rss = $modules->get("MarkupRSSEnhanced");
	$rss->title = $rssTitle;
	$rss->description = $rssDesc;
	$rss->itemDescriptionField = 'summary';
	$items = $page->children("limit={$limit}, sort=-date");
	$rss->render($items);

	exit();

}

you can also roll your own feed by using like an atom class:

/* ATOM
-------------------------------------*/
if($input->urlSegment1 == 'atom.xml') {

	include("./classes/atom1.class.php");

	$atom = new atom1(
	    $rssTitle,
	    $page->httpUrl . 'atom.xml',
	    $default_author,
	    $page->httpUrl . 'atom.xml'
	);

	$posts = $page->children("limit={$limit}");

	foreach($posts as $post) {
		$atom->addEntry(
			$post->title,
			$post->httpUrl,
			$post->wordLimiter('body', 400),
            $post->getUnformatted('date'),
            $post->id
        );
	}

	header( 'Content-Type: text/xml' );
	print $atom->saveXML();

	exit();
}

i'm using a slightly modified atom class from PHP Cookbook, so i can't post it here, but it's a very simple class which extends DOMDocument...

  • Like 1

Share this post


Link to post
Share on other sites

I have a problem with this module (and also atom feed loader module) in a website. 

I was able to make the module work changing the php version to an older one (maybe 5.3 or 5.4 I don't remember), but my provider (for other problems) needs to run php 5.5 version

When I have this version it doesn't work.

I don't get any errors and if I add 

if($rss->error) { echo "<p>{$rss->error}</p>"; } 

simply it outputs 

Unable to load Atom feed at https://www.youtube.com/feeds/videos.xml?playlist_id=... 

I don't know if the problem is caused by php 5.5 or some other php settings.

EDIT: I have seen that the same script is running fine on another server with php 5.5 so I think the problem is related to php settings.

Do you have an idea how to fix or debug this problem?

Thank you

Share this post


Link to post
Share on other sites

It sounds like it is an allow_url_fopen issue. Edit your php.ini to set it to "On" and the module should work fine.

  • Like 1

Share this post


Link to post
Share on other sites

Thank you Andrian for the incredible support.

I have contacted my provider suggesting your solution.

I will update this post as soon as I have the confirm that it works. Thank you!

Edit: Finally it works and seems there was a firewall problem.

  • Like 1

Share this post


Link to post
Share on other sites

I've got it working and displaying the last 6 items from a test feed in a page using the MarkupLoadRSS module, would it possible to include pagination so you can go to the previous/next 6 results?

And while I'm at it, is it possible to perform search and filters on the feed to get specific results as well?

Share this post


Link to post
Share on other sites

I didn't know it was possible. but RSS seems to support pagination;

This is defined in RFC 5005, Feed Paging and Archiving, section 3.

You can use first, previous, next and last as a link relation:

<link rel="next" href="http://example.org/index.atom?page=2"/>

you'd need to hack the module i think though in order to support the pagination.

In terms of filtered feed that sounds riskier, but you can always load the feed with a different page array, shouldn't be any issue, maybe you can explain more about why you need it - i guess you want different feeds with different titles, but want to generate them all off the same page?

Share this post


Link to post
Share on other sites

Ok again a new question in the round.

I'm not sure if I should write it into the plugin forum or here, if then please move.

I think I've ever asked 1-2 years ago, probably in a different profile but I know not, and could not find it.

With MarkupLoadRSS I'm writing from an RSS feed on the page.

I would like this but, or an item's it like to spend in a slider and link first intern.

My question would be the following:
How would it do that I disc reading the RSS, then save as a Page?
To affairs it "internally" on and then refer only to the external target?

Share this post


Link to post
Share on other sites

I had a test feed in place and working perfectly in a template, as soon as I've put in a new feed Ive received teh error message "Warning: Invalid argument supplied for foreach() in /Applications/MAMP/htdocs/sirius_updated/site/modules/MarkupLoadRSS/MarkupLoadRSS.module on line 330".

The new feed contains CDATA, but I'm judging this shouldn't really be a problem, as there;s a post from the first page that works with this in.

Share this post


Link to post
Share on other sites

I would also like to know if its possible to load images with this module?

Share this post


Link to post
Share on other sites

This module will not throw runtime exceptions so if an error occurs, it's not going to halt the site.

I have this module set up and running on a site, there was an issue with the feed and it wouldn't load, but it also stopped the pages loading as well.

Share this post


Link to post
Share on other sites

If you wrap your own ajax handling around the markup the module does supply, yes. But there's no out of the box ajax.

Share this post


Link to post
Share on other sites
On 10/04/2016 at 3:57 AM, Piqsel said:

I would also like to know if its possible to load images with this module?

Yes, change lines 165 & 166 in MarkupLoadRSS.module to to

'stripTags' => false,             // Strip any markup tags that appear in the feed? (default: true)
'encodeEntities' => false,         // Whether to automatically decode and re-encode the entities for all fields (default: true)

Works a treat :-)!

Share this post


Link to post
Share on other sites
On 9/8/2016 at 1:32 PM, dab said:

Yes, change lines 165 & 166 in MarkupLoadRSS.module to to


'stripTags' => false,             // Strip any markup tags that appear in the feed? (default: true)
'encodeEntities' => false,         // Whether to automatically decode and re-encode the entities for all fields (default: true)

Works a treat :-)!

It does not work for images in my site

any suggestions? 

Share this post


Link to post
Share on other sites
39 minutes ago, grigorisk said:

It does not work for images in my site

any suggestions? 

Firstly, try this module instead: http://modules.processwire.com/modules/markup-rssenhanced/

Secondly, don't edit lines in the module, try passing the options array to the render method so that updates to the module won't break the functionality.

  • Like 1

Share this post


Link to post
Share on other sites

I'm currently working on a website where I would like to fetch data from an RSS feed and save them as actual pages inside ProcessWire.

Ideally ProcessWire is an exact copy of the RSS feed. When a new page is added to the RSS feed, the new page would also be added in ProcessWire. Or when a page got removed from the RSS feed, the page should also be delete from within ProcessWire.

I'm using the following setup:

1. Fetch the RSS feed with

$rss = $modules->get('MarkupLoadRSS');
$rss->load('http://www.domain.com/rss');

2. Compage the RSS feed with the pages that are currently save in Processwire

foreach ($rss as $item) {
...
}

3. If page is in RSS feed, but not in ProcessWire, save page

4. If page is in RSS feed and in ProcessWire, update values with data from the RSS feed

5. If page is not in RSS feed, but in ProcessWire, delete page

To get all the pages from the RSS feed, check if it exists and create the page from the API if it doesn't exist, i'm using the code below:

<?php

include './index.php'; // bootstrap PW

$rss = $modules->get('MarkupLoadRSS');
$rss->load('http://www.domain.com/rss');

foreach ($rss as $item) {
    $p = $pages->get("job_id=$item->id"); // get the ide of the job

    if (!$p->id) {
        $p = new Page(); // create new page object
        $p->template = 'job-offer'; // set template
        $p->parent = wire('pages')->get('/vacatures/'); // set the parent
        $p->name = slugify($item->title); // give it a name used in the url for the page
        $p->title = $item->title; // set page title (not neccessary but recommended)

        // added by Ryan: save page in preparation for adding files (#1)

        $p->save();

        // populate fields

        $p->job_id = $item->id;

        $p->save();

        // testing
        echo 'id: ' . $p->id . '<br/>';
        echo 'path: ' . $p->path;
    }
}

So far everything works and the pages got created 🙂

However I'm having trouble with the logic for points 4 and 5.

- When a page is in the RSS feed and is already add to ProcessWire. Is there a way to find a page and update it's content through the API?
- When a page is not in the RSS feed anymore. Is there a way to delete all pages that are not in the RSS feed?

Thanks!

Share this post


Link to post
Share on other sites
On 6/11/2018 at 4:39 AM, combicart said:

When a page is in the RSS feed and is already add to ProcessWire. Is there a way to find a page and update it's content through the API?

You already have part of the logic for this - now you just need the else. I would tend to flip the logic around the other way though...

if($p->id) {
    // $p is an existing page, so prepare it for saving new field values
    $p->of(false);
} else {
    // No existing page so create one
    $p = new Page();
    // ...
}
// Now set the field values of $p

 

On 6/11/2018 at 4:39 AM, combicart said:

When a page is not in the RSS feed anymore. Is there a way to delete all pages that are not in the RSS feed?

Keep track of the job ids in the RSS feed using an array. Then find any pages with job ids that are not in the array and delete them.

$job_ids = [];
foreach($rss as $item) {
    $job_ids[] = $item->id;
    // The rest of your code...
}

// Implode for use in selector string
$job_ids = implode('|', $job_ids);

// Find pages for deletion
$delete_pages = $pages->find("job_id!=$job_ids");
foreach($delete_pages as $delete_page) {
    $delete_page->delete();
}

 

  • Like 1

Share this post


Link to post
Share on other sites

I would like to import a description field including it's HTML markup. In the RSS feed the markup is included, however by default the markup is stripped by the RSS feed module.

Therefore i've used the option below to render the description including markup:

$rss->stripTags = false;

After adding this option, the values in the database are still escaped, e.g. like:

&lt;h3 class=&quot;deprecated-h3&quot;&gt;Description&lt;/h3&gt;
&lt;p&gt;Description&lt;/p&gt; 

Would it be possible to save  the description field directly into the database (including it's HTML markup)?

Share this post


Link to post
Share on other sites

Hi folks. Does this work over https? A few sites I was pulling the latest RSS feed from, since going to https, now no longer works.

I've bar dumped it and it states:

 

error protected => "Unable to load RSS feed at https://insidemodernism.co.uk/feed/:

error protected => "Unable to load RSS feed at https://insidemodernism.co.uk/feed/: 

Any thoughts?

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

  • Recently Browsing   0 members

    No registered users viewing this page.

  • Similar Content

    • By Gadgetto
      SnipWire - Snipcart integration for ProcessWire
      Snipcart is a powerful 3rd party, developer-first HTML/JavaScript shopping cart platform. SnipWire is the missing link between Snipcart and the content management framework ProcessWire.
      With SnipWire, you can quickly turn any ProcessWire site into a Snipcart online shop. The SnipWire plugin helps you to get your store up and running in no time. Detailed knowledge of the Snipcart system is not required.
      SnipWire is free and open source licensed under Mozilla Public License 2.0! A lot of work and effort has gone into development. It would be nice if you could donate an amount to support further development:

      Status update links (inside this thread) for SnipWire development
      2020-07-03 -- SnipWire 0.8.7 (beta) released! Fixes some small bugs and adds an indicator for TEST mode 2020-04-06 -- SnipWire 0.8.6 (beta) released! Adds support for Snipcart subscriptions and also fixes some problems 2020-03-21 -- SnipWire 0.8.5 (beta) released! Improves SnipWires webhooks interface and provides some other fixes and additions 2020-03-03 -- SnipWire 0.8.4 (beta) released! Improves compatibility for Windows based Systems. 2020-03-01 -- SnipWire 0.8.3 (beta) released! The installation and uninstallation process has been heavily revised. 2020-02-08 -- SnipWire 0.8.2 (beta) released! Added a feature to change the cart and catalogue currency by GET, POST or SESSION param 2020-02-03 -- SnipWire 0.8.1 (beta) released! All custom classes moved into their own namespaces. 2020-02-01 -- SnipWire is now available via ProcessWire's module directory! 2020-01-30 -- SnipWire 0.8.0 (beta) first public release! (module just submitted to the PW modules directory) 2020-01-28 -- added Custom Order Fields feature (first SnipWire release version is near!) 2020-01-21 -- Snipcart v3 - when will the new cart system be implemented? 2020-01-19 -- integrated taxes provider finished (+ very flexible shipping taxes handling) 2020-01-14 -- new date range picker, discount editor, order notifiactions, order statuses, and more ... 2019-11-15 -- orders filter, order details, download + resend invoices, refunds 2019-10-18 -- list filters, REST API improvements, new docs platform, and more ... 2019-08-08 -- dashboard interface, currency selector, managing Orders, Customers and Products, Added a WireTabs, refinded caching behavior 2019-06-15 -- taxes provider, shop templates update, multiCURL implementation, and more ... 2019-06-02 -- FieldtypeSnipWireTaxSelector 2019-05-25 -- SnipWire will be free and open source Plugin Key Features
      Fast and simple store setup Full integration of the Snipcart dashboard into the ProcessWire backend (no need to leave the ProcessWire admin area) Browse and manage orders, customers, discounts, abandoned carts, and more Multi currency support Custom order and cart fields Process refunds and send customer notifications from within the ProcessWire backend Process Abandoned Carts + sending messages to customers from within the ProcessWire backend Complete Snipcart webhooks integration (all events are hookable via ProcessWire hooks) Integrated taxes provider (which is more flexible then Snipcart own provider) Useful Links
      SnipWire in PW modules directory SnipWire Docs (please note that the documentation is a work in progress) SnipWire @GitHub (feature requests and suggestions for improvement are welcome - I also accept pull requests) Snipcart Website  

       
      ---- INITIAL POST FROM 2019-05-25 ----
       
    • By Sten
      Hello
      Till now I hacked something with the twig template but it works no more with new PW versions so I look forward to create a module. I am working on a site in multiple languages : French, English, Italian, German, Spanish, Portuguese, Hebrew, Russian. The new posts are entered in any language with a field for language. Till now, I got twig files to get the translations with constants defined for each part of the pages.
      So I'd like to create a module to include theses files added according to the url /fr/en/...
      Have you some observations to do before I begin about the direction to take ?
      Thank you
    • By ukyo
      Mystique Module for ProcessWire CMS/CMF
      Github repo : https://github.com/trk/Mystique
      Mystique module allow you to create dynamic fields and store dynamic fields data on database by using a config file.
      Requirements
      ProcessWire 3.0 or newer PHP 7.0 or newer FieldtypeMystique InputfieldMystique Installation
      Install the module from the modules directory:
      Via Composer:
      composer require trk/mystique Via git clone:
      cd your-processwire-project-folder/ cd site/modules/ git clone https://github.com/trk/Mystique.git Module in live reaction with your Mystique config file
      This mean if you remove a field from your config file, field will be removed from edit screen. As you see on youtube video.
      Using Mystique with your module or use different configs path, autoload need to be true for modules
      Default configs path is site/templates/configs/, and your config file name need to start with Mystique. and need to end with .php extension.
      Adding custom path not supporting anymore !
      // Add your custom path inside your module class`init` function, didn't tested outside public function init() { $path = __DIR__ . DIRECTORY_SEPARATOR . 'configs' . DIRECTORY_SEPARATOR; Mystique::add($path); } Mystique module will search site/modules/**/configs/Mystique.*.php and site/templates/Mystique.*.php paths for Mystique config files.
      All config files need to return a PHP ARRAY like examples.
      Usage almost same with ProcessWire Inputfield Api, only difference is set and showIf usage like on example.
      <?php namespace ProcessWire; /** * Resource : testing-mystique */ return [ 'title' => __('Testing Mystique'), 'fields' => [ 'text_field' => [ 'label' => __('You can use short named types'), 'description' => __('In file showIf working like example'), 'notes' => __('Also you can use $input->set() method'), 'type' => 'text', 'showIf' => [ 'another_text' => "=''" ], 'set' => [ 'showCount' => InputfieldText::showCountChars, 'maxlength' => 255 ], 'attr' => [ 'attr-foo' => 'bar', 'attr-bar' => 'foo' ] ], 'another_text' => [ 'label' => __('Another text field (default type is text)') ] ] ]; Example:
      site/templates/configs/Mystique.seo-fields.php <?php namespace ProcessWire; /** * Resource : seo-fields */ return [ 'title' => __('Seo fields'), 'fields' => [ 'window_title' => [ 'label' => __('Window title'), 'type' => Mystique::TEXT, // or InputfieldText 'useLanguages' => true, 'attr' => [ 'placeholder' => __('Enter a window title') ] ], 'navigation_title' => [ 'label' => __('Navigation title'), 'type' => Mystique::TEXT, // or InputfieldText 'useLanguages' => true, 'showIf' => [ 'window_title' => "!=''" ], 'attr' => [ 'placeholder' => __('Enter a navigation title') ] ], 'description' => [ 'label' => __('Description for search engines'), 'type' => Mystique::TEXTAREA, 'useLanguages' => true ], 'page_tpye' => [ 'label' => __('Type'), 'type' => Mystique::SELECT, 'options' => [ 'basic' => __('Basic page'), 'gallery' => __('Gallery'), 'blog' => __('Blog') ] ], 'show_on_nav' => [ 'label' => __('Display this page on navigation'), 'type' => Mystique::CHECKBOX ] ] ]; Searching data on Mystique field is limited. Because, Mystique saving data to database in json format. When you make search for Mystique field, operator not important. Operator will be changed with %= operator.
      Search example
      $navigationPages = pages()->find('my_mystique_field.show_on_nav=1'); $navigationPages = pages()->find('my_mystique_field.page_tpye=gallery');
    • By Robin S
      This is a module I made as an experiment a while ago and never got around to releasing publicly. At the time it was prompted by discussions around using Repeater fields for "page builder" purposes, where the depth feature could possibly be used for elements that would be nested inside other elements. I thought it would be useful to enforce some depth rules and translate the depth data into a multi-dimensional array structure.
      I'm not using this module anywhere myself but maybe it's useful to somebody.
      Repeater Depth Helper
      This module does two things relating to Repeater fields that have the "Item depth" option enabled:
      It enforces some depth rules for Repeater fields on save. Those rules are:
      The first item must have a depth of zero. Each item depth must not be more than one greater than previous item depth. It provides a RepeaterPageArray::getDepthStructure helper method that returns a nested depth structure for a Repeater field value.
      Helper method
      The module adds a RepeaterPageArray::getDepthStructure method that returns a multi-dimensional array where the key is the page ID and the value is an array of nested "child" items, or null if there are no nested children.
      Example

      The module doesn't make any assumptions about how you might want to use the depth structure array, but here is a way you might use it to output a nested unordered list.
      // Output a nested unordered list from a depth structure array function outputNestedList($depth_structure, $repeater_items) { $out = "<ul>"; foreach($depth_structure as $page_id => $nested_children) { $out .= "<li>" . $repeater_items->get("id=$page_id")->title; // Go recursive if there are nested children if(is_array($nested_children)) $out .= outputNestedList($nested_children, $repeater_items); $out .= "</li>"; } $out .= "</ul>"; return $out; } $repeater_items = $page->my_repeater; $depth_structure = $repeater_items->getDepthStructure(); echo outputNestedList($depth_structure, $repeater_items);
       
      https://github.com/Toutouwai/RepeaterDepthHelper
      https://modules.processwire.com/modules/repeater-depth-helper/
    • By MoritzLost
      Cacheable Placeholders
      This module allows you to have pieces of dynamic content inside cached output. This aims to solve the common problem of having a mostly cacheable site, but with pieces of dynamic output here and there.  Consider this simple example, where you want to output a custom greeting to the current user:
      <h1>Good morning, <?= ucfirst($user->name) ?></h1> This snippet means you can't use the template cache (at least for logged-in users), because each user has a different name. Even if 99% of your output is static, you can only cache the pieces that you know won't include this personal greeting. A more common example would be CSRF tokens for HTML forms - those need to be unique by definition, so you can't cache the form wholesale.
      This module solves this problem by introducing cacheable placeholders - small placeholder tokens that get replaced during every request. The replacement is done inside a Page::render hook so it runs during every request, even if the response is served from the template cache. So you can use something like this:
      <h1>Good morning, {{{greeting}}}</h1> Replacement tokens are defined with a callback function that produces the appropriate output and added to the module through a simple hook:
      // site/ready.php wire()->addHookAfter('CachePlaceholders::getTokens', function (HookEvent $e) { $tokens = $e->return; $tokens['greeting'] = [ 'callback' => function (array $tokenData) { return ucfirst(wire('user')->name); } ]; $e->return = $tokens; }); Tokens can also include parameters that are parsed and passed to the callback function. There are more fully annotated examples and step-by-step instructions in the README on Github!
      Features
      A simple and fast token parser that calls the appropriate callback and runs automatically. Tokens may include multiple named or positional parameters, as well as multi-value parameters. A manual mode that allows you to replace tokens in custom pieces of cached content (useful if you're using the $cache API). Some built-in tokens for common use-cases: CSRF-Tokens, replacing values from superglobals and producing random hexadecimal strings. The token format is completely customizable, all delimiters can be changed to avoid collisions with existing tag parsers or template languages. Links
      Github Repository & documentation Module directory If you are interested in learning more, the README is very extensive, with more usage examples, code samples and usage instructions!
×
×
  • Create New...