Jump to content
Markus (Blue Tomato)

ElasticsearchFeeder

Recommended Posts

ElasticsearchFeeder

This ElasticSearch module for ProcessWire will sync your page content to an ElasticSearch index, which provides you a convenient way to search it.

Thanks to @jonathan-dart who created the first ES Module for PW and which influenced us a lot. Our approach was to create an a module where we can make for each template a flexible schema. You can define on you own which data ind which format should be transfered to ElasticSearch.

 

Github Page: https://github.com/blue-tomato/ElasticsearchFeeder

Module Page: https://modules.processwire.com/modules/elasticsearch-feeder/

  • Like 13

Share this post


Link to post
Share on other sites
22 minutes ago, szabesz said:

Thanks for sharing your modules today 🙂 Just a quick note of a copy-paste error, this links to your other module:

Sorry, that was my fault - fixed now!

  • Like 1

Share this post


Link to post
Share on other sites

Hi @adrian

thanks... something is wrong with my forum account. I can't edit my posts, I can't edit my profile (picture etc.) and on the module page I am not visible ad author of the module... do you know what could be wrong?

 

image.thumb.png.471d495ed7a29968dca431092a74be70.png

 

 

Share this post


Link to post
Share on other sites
12 hours ago, bernhard said:

Hi @tiefenbacher_bluetomato, thx for sharing!

Do you have a demo for us where we can see it in action? 🙂

Not now but soon. We are developing around our ElasticSearch Instance a GraphQL Service and will than show Content from our Blog etc. in other heavy traffic section on https://www.blue-tomato.com

When it is live I will post it here

  • Like 2

Share this post


Link to post
Share on other sites

I forgot to write some update here.

We made some minor and one major release since 1.0.0 with this changes:

  • fix some log warnings from some Repeater fields
  • Module can now be installed via composer
  • Add support for $config->elasticsearchFeederConnectionOverride
  • Better support of own hosted ElasticSearch Servers
  • Use of PW 3.0.133's new $page->meta() feature instead of creating a fields for indexed pages
  • CI Tests via circleci.com and peridot-php

Current Version is 1.2.0 and since we use $page-meta() the module requires now PW 3.0.133

And a live production demo will follow the next 1-2 weeks.

 

  • Like 4

Share this post


Link to post
Share on other sites

Here now some details how we use ElasticsearchFeeder on www.blue-tomato.com:

Our main webshop technology is Java / SAP Hybris which is mostly developed by an external developer team. Hybris is good for multichannel webshops but not the best tool for general content management or for creating quick new content. So we use ProcessWire for our editoral content like blogs, landing pages, buyers guides etc. since 2 years. We created a RestAPI where SAP Hybris gets the content from ProcessWire. So ProcessWire prerenders the main-body and gives it with some metadata to Hybris which puts them between the webshop header and footer.

This works great with following page sections:

Since this are kind of static pages it worked very well but we want to integrate also our content dynamicly on other high traffic pages like the homepage or product detail pages. This is why we decided to put our content into ElasticSearch. In front of ElasticSearch we created an GraphQL / Node.js Server, because we mashup our ProcessWire data with product data from other (REST) sources.

For the first step we created two kind of widgets, which run on the Blue Tomato Homepage:

  • Blue World News (latest news from our blog)
  • Shop The Look

The Shop The Look Widget is our first try to mix and show data from different sources. The Editor of a "Look" has to create the look in the ProcessWire Admin panel. He uploads the look photo and has to put product IDs into a Table. No product price, title or image. All of the product data will be fetched by GraphQL from our other database during the request. All widgets are rendered with React.

1416878119_Bildschirmfoto2019-06-19um22_23_11.thumb.png.0028ac16a1386f12421fd7d4671a8f12.png

1310604572_Bildschirmfoto2019-06-19um22_23_23.thumb.png.5b6e10ace963f8d15f76e504dc60739d.png

I hope I could give you a short overview of what we do with ProcessWire and ElasticsearchFeeder.

 

  • Like 5

Share this post


Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.


  • Recently Browsing   0 members

    No registered users viewing this page.

×
×
  • Create New...