Jump to content
ryan

Module: Import Pages from CSV file

Recommended Posts

@kongondo

I'm importing on a local server. I was looking into the code to find something that's causing the slowdown, but i couldn't see anything unusual.

Share this post


Link to post
Share on other sites

What system you are using? Win > 7 ?

And what server setup you are using? (Mamp, Wamp XAMP, etc)

Edited by horst

Share this post


Link to post
Share on other sites

Anyone tried this with the dev branch of PW 3.0.x? I got to the second part, where connecting "columns" with fields. And it could not find the fields. Maybe I'm missing something, maybe it's not compatible?

Share this post


Link to post
Share on other sites

Anyone tried this with the dev branch of PW 3.0.x? I got to the second part, where connecting "columns" with fields. And it could find the fields. Maybe I'm missing something, maybe it's not compatible?

Could or could not? :-)

Share this post


Link to post
Share on other sites

I also bought the ListerPro where i can export Pages. 

In the export files I can see fields like PageTitle.data  which is for default language and Pagetitle.data1200  where 1200 is the ID of the second Language. 

How can I import them? Those fields are not selectable in CSV page import :(

Any hack or simple modification to change this or how I can import multilanguage fields? 

Thanks so much!

Share this post


Link to post
Share on other sites

Is importing field of type FieldtypeOption supported? I've been trying to, but the module won't pickup the columns for Option fields.

Thanks. :)

Share this post


Link to post
Share on other sites
Hi, thank for such a useful module.

I'm stuck with importing of multilanguage content.

Is there some way to import title and other fields for not default language?

Share this post


Link to post
Share on other sites

Has anyone used this module on 3.X branch? Using 3.0.8 i'm getting stuck on the 'Step 2' screen. It does not seem to grab the fields from the template i want to use for the pages to import. In the screenshot 'menu-item', but i've tried in a number of ways and different parents but no luck. I'm not getting any errors or anything but i get empty field dropdowns.

I'm aware that the module does not yet indicate compatibility with 3.X but most 2.X modules i tried worked fine with 3.X.

2016-02-13%2020_32_33-Start.png

Edit: for (cross)reference, a Github issue has also been made about this by another user. https://github.com/ryancramerdesign/ImportPagesCSV/issues/12

  • Like 2

Share this post


Link to post
Share on other sites

Same effect on 3.0.15, but some strange 'extra' effect.

I modified the array 'supported fieldtypes' and added TextUnique and Time:

protected $fieldtypes = array(
        'FieldtypePageTitle',
        'FieldtypeText',
        'FieldtypeTextarea',
        'FieldtypeInteger',
        'FieldtypeFloat',
        'FieldtypeEmail',
        'FieldtypeURL',
        'FieldtypeCheckbox',
        'FieldtypeFile',
        'FieldtypePage',
        'FieldtypeTextUnique',
        'FieldtypeTime',
        'FieldtypeDateTime',
        );

After that I can select these fields in the dropdowns, but the standard fields are still not available.

As I want to convert 700 pages from Drupal a working solution would be of great help.

Update: I got a 90% solution with Adrian's Batch child editor - I struggled a bit finding the CSV import settings for field pairings under 'page settings'.

Share this post


Link to post
Share on other sites

Update: I got a 90% solution with Adrian's Batch child editor - I struggled a bit finding the CSV import settings for field pairings under 'page settings'.

What's the missing 10% ? Did the field pairings work as expected? Is there anything I can do to make BCE work better for your needs?

  • Like 1

Share this post


Link to post
Share on other sites

Adrian,

I am sorry for misleading you with the 90% figure. It just describes my success in transferring Drupal data to ProcessWire in an automated way. The BCE module (thanks for that) is doing 100% what it should, the field pairings work great. My missing 10% is that I have to unwrap Drupal field collections into single fields for ProcessWire. I can do that probably on the CSV side and split the columns into fractions.

  • Like 1

Share this post


Link to post
Share on other sites

Hi, thank you so much Ryan for this amazing module. It helps me a lot.

I have in my .csv a column for countries: (France, Germany…). I would like those countries name to be imported as sub-pages of a “Countries” pages, with a template “country”. The page field “country” allows pages to be created from it. I learn in Nik’post that such pages could be associated automatically (if I understand it well), but is it possible to create it from the .csv?

If I try to associate my csv field to the right PW field I get: ImportPagesCSV: Unable to import page because it has no required 'title' field or it is blank.

Any idea to help me solve my problem?

Share this post


Link to post
Share on other sites

Just use the same csv to create all the countries with the importer (disallow duplicates) before using it another time to import the pages linking to the countries.

Share this post


Link to post
Share on other sites

Just use the same csv to create all the countries with the importer (disallow duplicates) before using it another time to import the pages linking to the countries.

Thanks a lot for your clarification, that works perfectly.

Share this post


Link to post
Share on other sites

Is there a workaround to making it compatible with PW 3.0.15? 

  • Like 2

Share this post


Link to post
Share on other sites

Hi Zeka,

Removing these lines and I got the module running on 3.0.x.

  • Like 3

Share this post


Link to post
Share on other sites

Hi Zeka,

Removing these lines and I got the module running on 3.0.x.

Great! Tnx.

Share this post


Link to post
Share on other sites

I am trying to Import Pages from a CSV file in version 3.0.15 but I can't get it to work. Using the module: "Import Pages from CSV file"  In version 2 I have no problems. Anyone on the forum has checked already if this module is compatible with version 3? Please your feedback.

I have the problem in step 2 when I have to connect the field, the dropdown stays empty. 

Share this post


Link to post
Share on other sites

Hi All,

My csv file is as follows, headers= page_id, title, body, url. data=100,hello world, hello world again, hello-world. Once uploaded it returns the error "Missing required fields" What am I missing? 

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

  • Recently Browsing   0 members

    No registered users viewing this page.

  • Similar Content

    • By BitPoet
      Here's a small new module that started as a spinoff of a memcache proof-of-concept. Cache your strings and partials in-memory using Redis as a backend.
      CacheRedis
      All you need is a running Redis database. The module supports connection through regular TCP, over TLS and via unix domain sockets. Host and port are configurable, and authentication is supported too. Here's a screenshot of the module configuration options:

      I'll not go into too many details about the usage, you can see everything explained in the README on GitHub, and just highlight the most important points.
      When the module is active, you'll have a wired $redis variable, which means you can reach the module as $redis, wire("redis") or within Wire classes / modules as $this->redis.
      CacheRedis is strongly influenced by WireCache, and its usage is (hopefully) straight forward.
      // Store an entry in the cache under the given key name with the given value: $redis->store("cached_value_number_one", $expire, $value); // Retrieve a value from the cache $value = $redis->fetch($key); // Delete a cache entry $redis->delete("my_other_cached_value"); // Clear the whole cache $redis->flush(); // Retrieve a value from the cache, and if not found, create it through the given function // and store it with a lifetime of 5 minutes (300 seconds) $value = $redis->fetch($key, 300, function() use($page) { return "Page last changed on " . strftime('%m/%d/%Y %H:%M', $page->modified | $page->created); }); // Render a file using wireRenderFile and store it in the cache. // We'll pass a selector as the expiry value so this cache gets // emptied every time a page matching the selector is saved. $news = $redis->renderFile("partials/news.php", 'template=blog-post', ["page" => $page]); The module is still very crude work in progress, but I hope some of you feel daring, try it out and let me know in case anything breaks.
      Have fun!
    • By joshua
      This module is (yet another) way for implementing a cookie management solution.
      Of course there are several other possibilities:
      - https://processwire.com/talk/topic/22920-klaro-cookie-consent-manager/
      - https://github.com/webmanufaktur/CookieManagementBanner
      - https://github.com/johannesdachsel/cookiemonster
      - https://www.oiljs.org/
      - ... and so on ...
      In this module you can configure which kind of cookie categories you want to manage:

      You can also enable the support for respecting the Do-Not-Track (DNT) header to don't annoy users, who already decided for all their browsing experience.
      Currently there are four possible cookie groups:
      - Necessary (always enabled)
      - Statistics
      - Marketing
      - External Media
      All groups can be renamed, so feel free to use other cookie group names. I just haven't found a way to implement a "repeater like" field as configurable module field ...
      When you want to load specific scripts ( like Google Analytics, Google Maps, ...) only after the user's content to this specific category of cookies, just use the following script syntax:
      <script type="optin" data-type="text/javascript" data-category="statistics" data-src="/path/to/your/statistic/script.js"></script> <script type="optin" data-type="text/javascript" data-category="marketing" data-src="/path/to/your/mareketing/script.js"></script> <script type="optin" data-type="text/javascript" data-category="external_media" data-src="/path/to/your/external-media/script.js"></script> <script type="optin" data-type="text/javascript" data-category="marketing">console.log("Inline scripts are also working!");</script> The type has to be "optin" to get recognized by PrivacyWire, the data-attributes are giving hints, how the script shall be loaded, if the data-category is within the cookie consents of the user. These scripts are loaded asynchronously after the user made the decision.
      If you want to give the users the possibility to change their consent, you can use the following Textformatter:
      [[privacywire-choose-cookies]] It's planned to add also other Textformatters to opt-out of specific cookie groups or delete the whole consent cookie.
      You can also add a custom link to output the banner again with a link / button with following class:
      <a href="#" class="privacywire-show-options">Show Cookie Options</a> <button class="privacywire-show-options">Show Cookie Options</button> This module is still in development, but we already use it on several production websites.
      You find it here: PrivacyWire Git Repo
      Download as .zip
      I would love to hear your feedback 🙂
      CHANGELOG
      0.0.5 Multi-language support included completely (also in TextFormatter). Added possibility to async load other assets (e.g. <img type="optin" data-category="marketing" data-src="https://via.placeholder.com/300x300">) 0.0.4 Added possibility to add an imprint link to the banner 0.0.3 Multi-language support for module config (still in development) 0.0.2 First release 0.0.1 Early development
    • By MoritzLost
      This is a new module that provides a simple solution to clearing all your cache layers at once, and an extensible interface to perform various cache-related actions.
      The simple motivation behind this module was that I was tired of manually clearing caches in several places after deploying a change on a live site. The basic purpose of this module is a simple Clear all caches link in the Setup menu which clears out all caches, no matter where they hide. You can customize what exactly the module does through it's configuration menu:
      Expire or delete all cache entries in the database, or selectively clear caches by namespace ($cache API) Clear the the template render cache. Clear out specific folders inside your site's cache directory (/site/assets/cache) Refresh version strings for static assets to bust client-side browser caches (this requires some setup, see the full documentation for details). This is the basic function of the module. However, you can also add different cache management action through the API and execute them through the module's interface. For this advanced usage, the module provides:
      An interface to see all available cache actions and execute them. A system log and logging output on the module page to see verify what the module is doing. A CacheControlTools class with utility functions to clear out different caches. An API to add cache actions, execute them programmatically and even modify the default action. Permission management, allowing you granular control over which user roles can execute which actions. The complete documentation can be found in the module's README.
      Beta release
      Note that I consider this a Beta release. Since the module is relatively aggressive in deleting some caches, I would advise you to install in on a test environment before using it on a live site.
      Let me know if you're getting any errors, have trouble using the module or if you have suggestions for improvement!
      In particular, can someone let me know if this module causes any problems with the ProCache module? I don't own or use it, so I can't check. As far as I can tell, ProCache uses a folder inside the cache directory to cache static pages, so my module should be able to clear the ProCache site cache as well, I'd appreciate it if someone can test that for me.
      Future plans
      If there is some interest in this, I plan to expand this to a more general cache management solution. I particular, I would like to add additional cache actions. Some ideas that came to mind:
      Warming up the template render cache for publicly accessible pages. Removing all active user sessions. Let me know if you have more suggestions!
      Links
      https://github.com/MoritzLost/ProcessCacheControl ProcessCacheControl in the Module directory

    • By David Karich
      Admin Page Tree Multiple Sorting
      ClassName: ProcessPageListMultipleSorting
      Extend the ordinary sort of children of a template in the admin page tree with multiple properties. For each template, you can define your own rule. Write each template (template-name) in a row, followed by a colon and then the additional field names for sorting.
      Example: All children of the template "blog" to be sorted in descending order according to the date of creation, then descending by modification date, and then by title. Type:
      blog: -created, -modified, title  Installation
      Copy the files for this module to /site/modules/ProcessPageListMultipleSorting/ In admin: Modules > Check for new modules. Install Module "Admin Page Tree Multible Sorting". Alternative in ProcessWire 2.4+
      Login to ProcessWire backend and go to Modules Click tab "New" and enter Module Class Name: "ProcessPageListMultipleSorting" Click "Download and Install"   Compatibility   I have currently tested the module only under PW 2.6+, but think that it works on older versions too. Maybe someone can give a feedback.     Download   PW-Repo: http://modules.processwire.com/modules/process-page-list-multiple-sorting/ GitHub: https://github.com/FlipZoomMedia/Processwire-ProcessPageListMultipleSorting     I hope someone can use the module. Have fun and best regards, David
×
×
  • Create New...