Jump to content
bernhard

RockGrid - powerful, performant and beautiful data listing tool

Recommended Posts

Important security update!

Hi RockGrid users,

I'm very sorry for that, but I have to announce a security update. If you are using RockGrid on a public site please upgrade to v0.0.22 (Fieldtype) immediately. It is a simple but important update: https://github.com/BernhardBaumrock/FieldtypeRockGrid/commit/0be2086139c84f775937246ed2985ac4c4a3e9c3; The proplem exists on all RockGrid fields with AJAX turned ON. In this case it was theoretically possible to expose the field data to a user that should not be allowed to see this data (in the worst case even a guest user) if the user knew how to do it and he also knew the name of the rockgrid field.

The update now restricts access for AJAX field data to superusers only. You can easily adjust that via simple hooks:

// rockgrid access control
$wire->addHookAfter("InputfieldRockGrid::access", function(HookEvent $event) {
  // all grid data is accessible for all logged in users
  $event->return = $this->user->isLoggedin();
});

Or more granular via the fieldname:

// rockgrid access control
$wire->addHookAfter("InputfieldRockGrid::access", function(HookEvent $event) {
  $field = $event->arguments(0);
  $user = $this->user;
  $access = $event->return;

  switch($field) {
    case 'field1':
    case 'field2':
    case 'field3':
      $access = $user->isLoggedin();
      break;

    case 'field4':
      $access = ($user->name == 'foo');
      break;
  }

  $event->return = $access;
});

Field 1-3 is allowed for logged in users, field4 only for user foo and all other fields only for superusers (default rule).

I'm not totally happy any more with several aspects of RockFinder and RockGrid, but it is the best option I have so far (until I can build something totally new, maybe with tabulator if tests work well).

Special thx to @Zeka for bringing this issue to my attention by coincidence in the other topic!

  • Like 6
  • Thanks 1

Share this post


Link to post
Share on other sites

I am trying to figure out how to join pages from two templates into a grid. I will attach a picture of an incorrect result just as a talking point:

rockfinder_join.thumb.png.c85d712768f896aeba2c03a56c3c8427.png

The goal would be to plonk the data from unive into the grid, with rows filled only when code and number match the ones in the main (A-T) grid. The incorrectly repeating result in the screenshot was reached with this:

$finder1 = new RockFinder('template=A-T', ['code', 'nb', 'variation', 'name']);
$finder2 = new RockFinder('template=unive3', ['code', 'nb', 'proverbtype']);
// join finder
$finder1->join($finder2, 'unive', ['code' => 'code']);
$this->setData($finder1);

So how can I match by two fields to get what I want?

Share this post


Link to post
Share on other sites

Hi Beluga,

is this a tabulator grid? Is it a custom module or the rockgrid extension you've linked some time ago?

Regarding your join: I think in that case it would be the easiest to join them via plain sql; Something like

$foo = $finder1->getSQL();
$bar = $finder2->getSQL();
$sql = "SELECT * FROM ($foo) AS foo LEFT JOIN ($bar) as bar ON (foo.col1 = bar.col1 AND foo.col2 = bar.col2)";
$this->setData($sql);

PS: Be careful when joining / listing tables that have same name columns! This can lead to different results in the grid than in the resulting sql table. Compare the results to a regular SQL client by copying the resulting sql and executing it in Adminer and similar...

  • Like 1
  • Thanks 1

Share this post


Link to post
Share on other sites

Woooaw - with your query and renaming the fields of the other template, I got a perfect result!! (You were right that the column names have to be different) Thanks a lot.

This is using my old hacky Tabulator grid 🙂

  • Like 2

Share this post


Link to post
Share on other sites

Glad it worked 🙂

Yeah, it's good old SQL and RockFinder taking away the complexity of getting all fields related to a page/template and taking into account PW statuses. Though one has to be careful about access control related to fields, related pages, referenced page statuses etc...

Share this post


Link to post
Share on other sites

Should the page refresh when using the view, edit, delete if i would delete the page through RockGrid?

 

col = RockGrid.colDefs.rowActions(col);
col.pinned = 'left';
col.width = 120;

image.png.7962f6743de24484cf2b02eb685a8cca.png

For now it just spins and if i refresh the page it shows that the deletion worked.

 

My console:

[{action: "trash", payload: ["1949"], response: "Trashed 1 pages"}]

Share this post


Link to post
Share on other sites
1 hour ago, gottberg said:

Should the page refresh when using the view, edit, delete if i would delete the page through RockGrid?

view+edit: no (not by default)

delete: yes

Share this post


Link to post
Share on other sites
8 minutes ago, bernhard said:

view+edit: no (not by default)

delete: yes

Okey, but if i delete it does not do that. I just spins and when i refresh the page it is deleted.

Any ideas?

Share this post


Link to post
Share on other sites
36 minutes ago, gottberg said:

Any ideas?

Sorry, no - otherwise I would of course have posted them above. Please debug it, check the console for errors, try different browsers etc.; It is working here on all my installations.

Share this post


Link to post
Share on other sites

Sorry, didnt think that through 😄

I get the same errors i Firefox:

JqueryCore.js?v=1545420649:2 POST http://localhost/celsa/pw/celsacalc/?RockGrid=1&field=Transportzoner net::ERR_CONTENT_DECODING_FAILED 200 (OK)

Could i have some issues with the Module?

image.png.a242f17b66d4f524dae8d01bf03742b3.png

Also shows undefiend: 25

 

Edit: Trashcan also shows as undefined.

Share this post


Link to post
Share on other sites
On 6/30/2018 at 5:38 PM, bernhard said:

Support: Please note that this module might not be as easy and plug&play as many other modules. It needs a good understanding of agGrid (and JavaScript in general) and it likely needs some looks into the code to get all the options. Please understand that I can not provide free support for every request here in the forum. I try to answer all questions that might also help others or that might improve the module but for individual requests I offer paid support for 60€ per hour (excl vat).

I'm sorry but I can't help you further than I did with this one. If you want me to have a look at your setup you can contact me via email/PM.

Share this post


Link to post
Share on other sites
Posted (edited)
8 hours ago, gottberg said:

Could i have some issues with the Module?

Looking at the error you got, you could fix it by enabling zlib.output_compression in your php.ini.

ps: to be clear, you have a server issue.

 

 

Edited by flydev
ps

Share this post


Link to post
Share on other sites
On 6/4/2019 at 11:48 AM, bernhard said:

I'm sorry but I can't help you further than I did with this one. If you want me to have a look at your setup you can contact me via email/PM.

Thank you so much for the help you gave! Bernhard helped me through Skype and TeamViewer and solved the issue. I have and had some issues with MAMP.

He also gave me some pointers of how to use RockGrid and best practises etc. Worth every €!!!

I recommend to use RockGrid if you need to list and edit data. I also recommend to contact Bernhard and buy some support if you want to quickly learn how to use RockGrid! 🙂 

  • Like 1
  • Thanks 1

Share this post


Link to post
Share on other sites
On 6/4/2019 at 8:13 PM, flydev said:

Looking at the error you got, you could fix it by enabling zlib.output_compression in your php.ini.

ps: to be clear, you have a server issue.

 

 

Thanks for the tip! Tried that but i doesn't help.. 😞 

Share this post


Link to post
Share on other sites

Thx @gottberg, glad we could find a sulution even though we couldn't find the reason for the issue 🙂 

  • Like 1

Share this post


Link to post
Share on other sites

I am wondering how to optimise a query. It is taking 23 seconds on a server with 4GB of memory. It is live here: https://mattikuusiproverbtypology.fi/references/

I have considered moving to static JS data as the data in the db does not change very often.
The query is:

$finder1 = new RockFinder('template=A-T', ['code', 'nb', 'variation', 'name', 'page1', 'page2', 'page3', 'runningnb', 'additnb', 'abbrevat']);
$finder2 = new RockFinder('template=M6books', ['abbrev', 'author_editor', 'booktitle']);
$at = $finder1->getSQL();
$m6books = $finder2->getSQL();
$sql = "SELECT * FROM ($at) AS at LEFT JOIN ($m6books) as m6books ON (at.abbrevat = m6books.abbrev)";
$this->setData($sql);

I temporarily enabled slow_query_log like so in my.cnf:

long_query_time=1
slow_query_log=1
slow_query_log_file=/var/log/mysql/slow-query.log

(with /var/log/mysql owned by mysql user)

Below is the slow query log - for some reason it contains two identical queries, each taking over 9 seconds. I wonder why that is? Due to ajax? Does this happen to others?
 

Spoiler



/usr/bin/mysqld, Version: 10.3.15-MariaDB-log (Source distribution). started with:
Tcp port: 0  Unix socket: /run/mysqld/mysqld.sock
Time            Id Command    Argument
# Time: 190616  9:07:29
# User@Host: root[root] @ localhost []
# Thread_id: 9  Schema: x  QC_hit: No
# Query_time: 9.433453  Lock_time: 0.009225  Rows_sent: 36276  Rows_examined: 515142
# Rows_affected: 0  Bytes_sent: 5495003
use x;
SET timestamp=1560665249;
SELECT * FROM (SELECT
    `rockfinder`.*
FROM
    /* original pw query */
    (SELECT pages.id
    FROM `pages`
    LEFT JOIN pages_access ON (pages_access.pages_id=pages.id AND pages_access.templates_id IN(2,3))
    WHERE (pages.templates_id=43)
    AND (pages.status<1024)
    AND pages.templates_id NOT IN(2,3)
    AND pages_access.pages_id IS NULL
    GROUP BY pages.id ) as `pwfinder`

/* rockfinder */
LEFT JOIN (    SELECT
      `pages`.`id` AS `id`,
      `code`.`code` AS `code`,
      `nb`.`nb` AS `nb`,
      `variation`.`variation` AS `variation`,
      `name`.`name` AS `name`,
      `page1`.`page1` AS `page1`,
      `page2`.`page2` AS `page2`,
      `page3`.`page3` AS `page3`,
      `runningnb`.`runningnb` AS `runningnb`,
      `additnb`.`additnb` AS `additnb`,
      `abbrevat`.`abbrevat` AS `abbrevat`
    FROM
      `pages`
    
    /* --- join code --- */
    LEFT JOIN (SELECT
      `pages_id` AS `pageid`,
      `code`.`data` AS `code`
    FROM `field_code` AS `code`) AS `code` ON `code`.`pageid` = `pages`.`id`
    /* --- end code --- */
    
    
    /* --- join nb --- */
    LEFT JOIN (SELECT
      `pages_id` AS `pageid`,
      `nb`.`data` AS `nb`
    FROM `field_nb` AS `nb`) AS `nb` ON `nb`.`pageid` = `pages`.`id`
    /* --- end nb --- */
    
    
    /* --- join variation --- */
    LEFT JOIN (SELECT
      `pages_id` AS `pageid`,
      `variation`.`data` AS `variation`
    FROM `field_variation` AS `variation`) AS `variation` ON `variation`.`pageid` = `pages`.`id`
    /* --- end variation --- */
    
    
    /* --- join name --- */
    LEFT JOIN (SELECT `id` AS `pageid`, `name` FROM `pages` AS `name`) AS `name` ON `name`.`pageid` = `pages`.`id`
    /* --- end name --- */
    
    
    /* --- join page1 --- */
    LEFT JOIN (SELECT
      `pages_id` AS `pageid`,
      `page1`.`data` AS `page1`
    FROM `field_page1` AS `page1`) AS `page1` ON `page1`.`pageid` = `pages`.`id`
    /* --- end page1 --- */
    
    
    /* --- join page2 --- */
    LEFT JOIN (SELECT
      `pages_id` AS `pageid`,
      `page2`.`data` AS `page2`
    FROM `field_page2` AS `page2`) AS `page2` ON `page2`.`pageid` = `pages`.`id`
    /* --- end page2 --- */
    
    
    /* --- join page3 --- */
    LEFT JOIN (SELECT
      `pages_id` AS `pageid`,
      `page3`.`data` AS `page3`
    FROM `field_page3` AS `page3`) AS `page3` ON `page3`.`pageid` = `pages`.`id`
    /* --- end page3 --- */
    
    
    /* --- join runningnb --- */
    LEFT JOIN (SELECT
      `pages_id` AS `pageid`,
      `runningnb`.`data` AS `runningnb`
    FROM `field_runningnb` AS `runningnb`) AS `runningnb` ON `runningnb`.`pageid` = `pages`.`id`
    /* --- end runningnb --- */
    
    
    /* --- join additnb --- */
    LEFT JOIN (SELECT
      `pages_id` AS `pageid`,
      `additnb`.`data` AS `additnb`
    FROM `field_additnb` AS `additnb`) AS `additnb` ON `additnb`.`pageid` = `pages`.`id`
    /* --- end additnb --- */
    
    
    /* --- join abbrevat --- */
    LEFT JOIN (SELECT
      `pages_id` AS `pageid`,
      `abbrevat`.`data` AS `abbrevat`
    FROM `field_abbrevat` AS `abbrevat`) AS `abbrevat` ON `abbrevat`.`pageid` = `pages`.`id`
    /* --- end abbrevat --- */
    
) AS `rockfinder` ON `pwfinder`.`id` = `rockfinder`.`id`
/* end rockfinder */) AS at LEFT JOIN (SELECT
    `rockfinder`.*
FROM
    /* original pw query */
    (SELECT pages.id
    FROM `pages`
    LEFT JOIN pages_access ON (pages_access.pages_id=pages.id AND pages_access.templates_id IN(2,3))
    WHERE (pages.templates_id=45)
    AND (pages.status<1024)
    AND pages.templates_id NOT IN(2,3)
    AND pages_access.pages_id IS NULL
    GROUP BY pages.id ) as `pwfinder`

/* rockfinder */
LEFT JOIN (    SELECT
      `pages`.`id` AS `id`,
      `abbrev`.`abbrev` AS `abbrev`,
      `author_editor`.`author_editor` AS `author_editor`,
      `booktitle`.`booktitle` AS `booktitle`
    FROM
      `pages`
    
    /* --- join abbrev --- */
    LEFT JOIN (SELECT
      `pages_id` AS `pageid`,
      `abbrev`.`data` AS `abbrev`
    FROM `field_abbrev` AS `abbrev`) AS `abbrev` ON `abbrev`.`pageid` = `pages`.`id`
    /* --- end abbrev --- */
    
    
    /* --- join author_editor --- */
    LEFT JOIN (SELECT
      `pages_id` AS `pageid`,
      `author_editor`.`data` AS `author_editor`
    FROM `field_author_editor` AS `author_editor`) AS `author_editor` ON `author_editor`.`pageid` = `pages`.`id`
    /* --- end author_editor --- */
    
    
    /* --- join booktitle --- */
    LEFT JOIN (SELECT
      `pages_id` AS `pageid`,
      `booktitle`.`data` AS `booktitle`
    FROM `field_booktitle` AS `booktitle`) AS `booktitle` ON `booktitle`.`pageid` = `pages`.`id`
    /* --- end booktitle --- */
    
) AS `rockfinder` ON `pwfinder`.`id` = `rockfinder`.`id`
/* end rockfinder */) as m6books ON (at.abbrevat = m6books.abbrev);
# Time: 190616  9:07:39
# User@Host: root[root] @ localhost []
# Thread_id: 10  Schema: x  QC_hit: No
# Query_time: 9.203892  Lock_time: 0.001161  Rows_sent: 36276  Rows_examined: 515142
# Rows_affected: 0  Bytes_sent: 5495003
SET timestamp=1560665259;
SELECT * FROM (SELECT
    `rockfinder`.*
FROM
    /* original pw query */
    (SELECT pages.id
    FROM `pages`
    LEFT JOIN pages_access ON (pages_access.pages_id=pages.id AND pages_access.templates_id IN(2,3))
    WHERE (pages.templates_id=43)
    AND (pages.status<1024)
    AND pages_access.pages_id IS NULL
    AND pages.templates_id NOT IN(2,3)
    GROUP BY pages.id ) as `pwfinder`

/* rockfinder */
LEFT JOIN (    SELECT
      `pages`.`id` AS `id`,
      `code`.`code` AS `code`,
      `nb`.`nb` AS `nb`,
      `variation`.`variation` AS `variation`,
      `name`.`name` AS `name`,
      `page1`.`page1` AS `page1`,
      `page2`.`page2` AS `page2`,
      `page3`.`page3` AS `page3`,
      `runningnb`.`runningnb` AS `runningnb`,
      `additnb`.`additnb` AS `additnb`,
      `abbrevat`.`abbrevat` AS `abbrevat`
    FROM
      `pages`
    
    /* --- join code --- */
    LEFT JOIN (SELECT
      `pages_id` AS `pageid`,
      `code`.`data` AS `code`
    FROM `field_code` AS `code`) AS `code` ON `code`.`pageid` = `pages`.`id`
    /* --- end code --- */
    
    
    /* --- join nb --- */
    LEFT JOIN (SELECT
      `pages_id` AS `pageid`,
      `nb`.`data` AS `nb`
    FROM `field_nb` AS `nb`) AS `nb` ON `nb`.`pageid` = `pages`.`id`
    /* --- end nb --- */
    
    
    /* --- join variation --- */
    LEFT JOIN (SELECT
      `pages_id` AS `pageid`,
      `variation`.`data` AS `variation`
    FROM `field_variation` AS `variation`) AS `variation` ON `variation`.`pageid` = `pages`.`id`
    /* --- end variation --- */
    
    
    /* --- join name --- */
    LEFT JOIN (SELECT `id` AS `pageid`, `name` FROM `pages` AS `name`) AS `name` ON `name`.`pageid` = `pages`.`id`
    /* --- end name --- */
    
    
    /* --- join page1 --- */
    LEFT JOIN (SELECT
      `pages_id` AS `pageid`,
      `page1`.`data` AS `page1`
    FROM `field_page1` AS `page1`) AS `page1` ON `page1`.`pageid` = `pages`.`id`
    /* --- end page1 --- */
    
    
    /* --- join page2 --- */
    LEFT JOIN (SELECT
      `pages_id` AS `pageid`,
      `page2`.`data` AS `page2`
    FROM `field_page2` AS `page2`) AS `page2` ON `page2`.`pageid` = `pages`.`id`
    /* --- end page2 --- */
    
    
    /* --- join page3 --- */
    LEFT JOIN (SELECT
      `pages_id` AS `pageid`,
      `page3`.`data` AS `page3`
    FROM `field_page3` AS `page3`) AS `page3` ON `page3`.`pageid` = `pages`.`id`
    /* --- end page3 --- */
    
    
    /* --- join runningnb --- */
    LEFT JOIN (SELECT
      `pages_id` AS `pageid`,
      `runningnb`.`data` AS `runningnb`
    FROM `field_runningnb` AS `runningnb`) AS `runningnb` ON `runningnb`.`pageid` = `pages`.`id`
    /* --- end runningnb --- */
    
    
    /* --- join additnb --- */
    LEFT JOIN (SELECT
      `pages_id` AS `pageid`,
      `additnb`.`data` AS `additnb`
    FROM `field_additnb` AS `additnb`) AS `additnb` ON `additnb`.`pageid` = `pages`.`id`
    /* --- end additnb --- */
    
    
    /* --- join abbrevat --- */
    LEFT JOIN (SELECT
      `pages_id` AS `pageid`,
      `abbrevat`.`data` AS `abbrevat`
    FROM `field_abbrevat` AS `abbrevat`) AS `abbrevat` ON `abbrevat`.`pageid` = `pages`.`id`
    /* --- end abbrevat --- */
    
) AS `rockfinder` ON `pwfinder`.`id` = `rockfinder`.`id`
/* end rockfinder */) AS at LEFT JOIN (SELECT
    `rockfinder`.*
FROM
    /* original pw query */
    (SELECT pages.id
    FROM `pages`
    LEFT JOIN pages_access ON (pages_access.pages_id=pages.id AND pages_access.templates_id IN(2,3))
    WHERE (pages.templates_id=45)
    AND (pages.status<1024)
    AND pages.templates_id NOT IN(2,3)
    AND pages_access.pages_id IS NULL
    GROUP BY pages.id ) as `pwfinder`

/* rockfinder */
LEFT JOIN (    SELECT
      `pages`.`id` AS `id`,
      `abbrev`.`abbrev` AS `abbrev`,
      `author_editor`.`author_editor` AS `author_editor`,
      `booktitle`.`booktitle` AS `booktitle`
    FROM
      `pages`
    
    /* --- join abbrev --- */
    LEFT JOIN (SELECT
      `pages_id` AS `pageid`,
      `abbrev`.`data` AS `abbrev`
    FROM `field_abbrev` AS `abbrev`) AS `abbrev` ON `abbrev`.`pageid` = `pages`.`id`
    /* --- end abbrev --- */
    
    
    /* --- join author_editor --- */
    LEFT JOIN (SELECT
      `pages_id` AS `pageid`,
      `author_editor`.`data` AS `author_editor`
    FROM `field_author_editor` AS `author_editor`) AS `author_editor` ON `author_editor`.`pageid` = `pages`.`id`
    /* --- end author_editor --- */
    
    
    /* --- join booktitle --- */
    LEFT JOIN (SELECT
      `pages_id` AS `pageid`,
      `booktitle`.`data` AS `booktitle`
    FROM `field_booktitle` AS `booktitle`) AS `booktitle` ON `booktitle`.`pageid` = `pages`.`id`
    /* --- end booktitle --- */
    
) AS `rockfinder` ON `pwfinder`.`id` = `rockfinder`.`id`
/* end rockfinder */) as m6books ON (at.abbrevat = m6books.abbrev);


 

My MySQL settings on the server are:
 

Spoiler

 

[mysqld]
port            = 3306
socket          = /run/mysqld/mysqld.sock
skip-external-locking
key_buffer_size = 32M
max_allowed_packet = 256M
table_open_cache = 2048
sort_buffer_size = 8M
net_buffer_length = 8K
read_buffer_size = 2M
read_rnd_buffer_size = 16M
myisam_sort_buffer_size = 128M
init_connect = 'SET collation_connection = utf8mb4_unicode_ci,NAMES utf8mb4'
collation_server = utf8mb4_unicode_ci
character_set_client = utf8mb4
character_set_server = utf8mb4
performance_schema = on
query_cache_size = 0

innodb_data_file_path = ibdata1:10M:autoextend
innodb_buffer_pool_size = 2G
innodb_log_file_size = 256M
innodb_log_buffer_size = 8M
innodb_flush_log_at_trx_commit = 1
innodb_lock_wait_timeout = 120
innodb_stats_on_metadata = 0
innodb_buffer_pool_instances = 2
innodb_flush_method = O_DIRECT

 

Results from mysqltuner:

Spoiler

-------- Storage Engine Statistics -----------------------------------------------------------------
[--] Status: +Aria +CSV +InnoDB +MEMORY +MRG_MyISAM +MyISAM +PERFORMANCE_SCHEMA +SEQUENCE
[--] Data in InnoDB tables: 55.1M (Tables: 92)
[--] Data in MyISAM tables: 981.2K (Tables: 31)
[OK] Total fragmented tables: 0
 
-------- Analysis Performance Metrics --------------------------------------------------------------
[--] innodb_stats_on_metadata: OFF
[OK] No stat updates during querying INFORMATION_SCHEMA.
 
-------- Security Recommendations ------------------------------------------------------------------
[OK] There are no anonymous accounts for any database users
[OK] All database users have passwords assigned
[!!] There is no basic password file list!
 
-------- CVE Security Recommendations --------------------------------------------------------------
[--] Skipped due to --cvefile option undefined
 
-------- Performance Metrics -----------------------------------------------------------------------
[--] Up for: 19s (10 q [0.526 qps], 15 conn, TX: 57K, RX: 1K)
[--] Reads / Writes: 100% / 0%
[--] Binary logging is enabled (GTID MODE: OFF)
[--] Physical Memory     : 3.8G
[--] Max MySQL memory    : 6.2G
[--] Other process memory: 0B
[--] Total buffers: 2.2G global + 26.5M per thread (151 max threads)
[--] P_S Max memory usage: 104M
[--] Galera GCache Max memory usage: 0B
[OK] Maximum reached memory usage: 2.3G (60.37% of installed RAM)
[!!] Maximum possible memory usage: 6.2G (162.06% of installed RAM)
[!!] Overall possible memory usage with other process exceeded memory
[OK] Slow queries: 0% (0/10)
[OK] Highest usage of available connections: 0% (1/151)
[!!] Aborted connections: 6.67%  (1/15)
[--] Skipped name resolution test due to skip_networking=ON in system variables.
[OK] Query cache is disabled by default due to mutex contention on multiprocessor machines.
[OK] No Sort requiring temporary tables
[OK] No joins without indexes
[OK] Temporary tables created on disk: 0% (0 on disk / 4 total)
[OK] Thread cache hit rate: 93% (1 created / 15 connections)
[OK] Table cache hit rate: 64% (11 open / 17 opened)
[OK] Open file limit used: 0% (26/4K)
[OK] Table locks acquired immediately: 100% (18 immediate / 18 locks)
[OK] Binlog cache memory access: 0% (0 Memory / 0 Total)
 
-------- Performance schema ------------------------------------------------------------------------
[--] Memory used by P_S: 104.0M
[--] Sys schema is installed.
 
-------- ThreadPool Metrics ------------------------------------------------------------------------
[--] ThreadPool stat is enabled.
[--] Thread Pool Size: 4 thread(s).
[--] Using default value is good enough for your version (10.3.15-MariaDB-log)
 
-------- MyISAM Metrics ----------------------------------------------------------------------------
[!!] Key buffer used: 18.3% (6M used / 33M cache)
[OK] Key buffer size / total MyISAM indexes: 32.0M/502.0K
 
-------- InnoDB Metrics ----------------------------------------------------------------------------
[--] InnoDB is enabled.
[--] InnoDB Thread Concurrency: 0
[OK] InnoDB File per table is activated
[OK] InnoDB buffer pool / data size: 2.0G/55.1M
[OK] Ratio InnoDB log file size / InnoDB Buffer pool size: 256.0M * 2/2.0G should be equal to 25%
[OK] InnoDB buffer pool instances: 2
[--] Number of InnoDB Buffer Pool Chunk : 16 for 2 Buffer Pool Instance(s)
[OK] Innodb_buffer_pool_size aligned with Innodb_buffer_pool_chunk_size & Innodb_buffer_pool_instances
[!!] InnoDB Read buffer efficiency: 60.52% (9061 hits/ 14972 total)
[!!] InnoDB Write Log efficiency: 0% (1 hits/ 0 total)
[OK] InnoDB log waits: 0.00% (0 waits / 1 writes)
 
-------- AriaDB Metrics ----------------------------------------------------------------------------
[--] AriaDB is enabled.
[OK] Aria pagecache size / total Aria indexes: 128.0M/1B
 
-------- TokuDB Metrics ----------------------------------------------------------------------------
[--] TokuDB is disabled.
 
-------- XtraDB Metrics ----------------------------------------------------------------------------
[--] XtraDB is disabled.
 
-------- Galera Metrics ----------------------------------------------------------------------------
[--] Galera is disabled.
 
-------- Replication Metrics -----------------------------------------------------------------------
[--] Galera Synchronous replication: NO
[--] No replication slave(s) for this server.
[--] Binlog format: MIXED
[--] XA support enabled: ON
[--] Semi synchronous replication Master: OFF
[--] Semi synchronous replication Slave: OFF
[--] This is a standalone server
 
-------- Recommendations ---------------------------------------------------------------------------
General recommendations:
    MySQL was started within the last 24 hours - recommendations may be inaccurate
    Reduce your overall MySQL memory footprint for system stability
    Dedicate this server to your database for highest performance.
    Reduce or eliminate unclosed connections and network issues

 

Share this post


Link to post
Share on other sites
20 hours ago, Beluga said:

I have considered moving to static JS data as the data in the db does not change very often.

So would caching be an (easy) option?

20 hours ago, Beluga said:

Below is the slow query log - for some reason it contains two identical queries, each taking over 9 seconds. I wonder why that is? Due to ajax? Does this happen to others?

At the moment this is how RockGrid works: It makes one query to get one row (so the query should have limit=0,1) so that it knows which columns to setup for the grid. Then the second request is to get all data (and this is also used for all subsequent requests when reloading the grid).

This is not the best solution, but I have no plans to change that for RockGrid. I start working on RockTabulator today where it will load all the data at the first request and display it instantly 🙂 

  • Like 4

Share this post


Link to post
Share on other sites
2 hours ago, bernhard said:

So would caching be an (easy) option?

At the moment this is how RockGrid works: It makes one query to get one row (so the query should have limit=0,1) so that it knows which columns to setup for the grid. Then the second request is to get all data (and this is also used for all subsequent requests when reloading the grid).

This is not the best solution, but I have no plans to change that for RockGrid. I start working on RockTabulator today where it will load all the data at the first request and display it instantly 🙂 

Yep, caching might be nice going forward. Anyway, I can solve this right now with the static JS (well, in theory - have not tried yet what the effect on load time is). It is great to hear you have a plan for RockTabulator regarding this!

Share this post


Link to post
Share on other sites
14 hours ago, bernhard said:

I start working on RockTabulator today

Yay! 😎

  • Haha 1

Share this post


Link to post
Share on other sites

The newest version of RockGrid now supports RockFinder2 as data source 😎

$finder = new RockFinder2();
$finder->find('template=basic-page');
$finder->addColumns([
  'title',
  'body'
]);
$this->setData($finder);

Data is available on the JS side via the RockFinder2 property in the GridItem object:

xbyUN7Y.png

  • Like 5

Share this post


Link to post
Share on other sites

Another little helpful update: Added support for colDef callbacks.

Before:

  col = grid.getColDef('id');
  col = RockGrid.colDefs.rowActions(col);

  col = grid.getColDef('created');
  col.headerName = 'Datum';
  col = RockGrid.colDefs.date(col);

After:


  grid.getColDef('id', function(col) {
    col = RockGrid.colDefs.rowActions(col);
  });
  
  grid.getColDef('created', function(col) {
    col.headerName = 'Datum';
    col = RockGrid.colDefs.date(col);
  });

The benefit is that before if the column did not exist for whatever reason (eg the column is hidden for some users) the JS broke and stopped execution because "col" was undefined and setting options on an undefined column definition doesn't work.

  • Like 1

Share this post


Link to post
Share on other sites

My first attempt at RockFinder & RockGrid and truly impressed. Well done @bernhard!

Have already created my dataset using joins, changing column headings and the tip for Select Options in my custom php file to display the option's title rather than the value in a column. All good.

Problem arises with the filter for the Select Options field, column is project_status, with column header changed to 'Status'. I've no idea how to change the filter from the PW assigned index value to the text value of the field.  See examples:

1. Full data set

1906379616_Screenshot2019-09-0617_37_47.png.e0c2b7abe08d27c672dcc70a20381c05.png

2. Using a text entry in the filter, eg starting to type 'draft'

1028955936_Screenshot2019-09-0617_38_00.png.4ece236c378671965fc04cf78ee274fd.png

3. Entering the PW assigned select options index for 'draft'

504013311_Screenshot2019-09-0617_38_17.png.3c6ef082e03d65721f3dfa02ea83ff7e.png

I'm guessing it needs a custom filter and would appreciate help and guidance.

TIA

psy

 

Share this post


Link to post
Share on other sites

Hi Psy,

In aggrid you have two concepts: valueGetters (https://www.ag-grid.com/javascript-grid-value-getters/) and cellRenderers (https://www.ag-grid.com/javascript-grid-cell-rendering-components/)

The filter filters the RAW VALUE of the cell, not the rendered value. You can either change the valueGetter of the cell or do another "workaround". But that's something conceptional when you are working with aggrid and you have to decide when to take which approach.

Have you tried double-clicking the cell, then it should filter for the value of the cell automatically. A triple click removes the filter from that column.

Share this post


Link to post
Share on other sites
11 minutes ago, psy said:

My first attempt at RockFinder & RockGrid and truly impressed. Well done @bernhard!

Thx, one can do a of great stuff with those tools and I think not many know about that... 🙂 But RockTabulator and RockFinder2 will make things a lot easier (if everything goes well).

  • Like 1

Share this post


Link to post
Share on other sites
7 minutes ago, bernhard said:

Have you tried double-clicking the cell, then it should filter for the value of the cell automatically. A triple click removes the filter from that column.

Well that worked, thanks! Not very user friendly though. The general public wont get it 😞

 

Share this post


Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.


  • Recently Browsing   0 members

    No registered users viewing this page.

  • Similar Content

    • By Mike Rockett
      Jumplinks for ProcessWire
      Release: 1.5.56
      Composer: rockett/jumplinks
      Jumplinks is an enhanced version of the original ProcessRedirects by Antti Peisa.
      The Process module manages your permanent and temporary redirects (we'll call these "jumplinks" from now on, unless in reference to redirects from another module), useful for when you're migrating over to ProcessWire from another system/platform. Each jumplink supports wildcards, shortening the time needed to create them.
      Unlike similar modules for other platforms, wildcards in Jumplinks are much easier to work with, as Regular Expressions are not fully exposed. Instead, parameters wrapped in curly braces are used - these are described in the documentation.
      Under Development: 2.0, to be powered by FastRoute
      As of version 1.5.0, Jumplinks requires at least ProcessWire 2.6.1 to run.
      View on GitLab
      Download via the Modules Directory
      Read the docs
      Features
      The most prominent features include:
      Basic jumplinks (from one fixed route to another) Parameter-based wildcards with "Smart" equivalents Mapping Collections (for converting ID-based routes to their named-equivalents without the need to create multiple jumplinks) Destination Selectors (for finding and redirecting to pages containing legacy location information) Timed Activation (activate and/or deactivate jumplinks at specific times) 404-Monitor (for creating jumplinks based on 404 hits) Additionally, the following features may come in handy:
      Stale jumplink management Legacy domain support for slow migrations An importer (from CSV or ProcessRedirects) Feedback & Feature Requests
      I’d love to know what you think of this module. Please provide some feedback on the module as a whole, or even regarding smaller things that make it whole. Also, please feel free to submit feature requests and their use-cases.
      Note: Features requested so far have been added to the to-do list, and will be added to 2.0, and not the current dev/master branches.
      Open Source

      Jumplinks is an open-source project, and is free to use. In fact, Jumplinks will always be open-source, and will always remain free to use. Forever. If you would like to support the development of Jumplinks, please consider making a small donation via PayPal.
      Enjoy! :)
    • By BitPoet
      As threatened in Ryan's announcement for 3.0.139, I built a little module for sliding toggles as a replacement for checkboxes. Styling of the input is CSS3 only (with all the usual caveats about older browsers), no JS necessary, and may still be a bit "rough around the edges", so to speak, since I didn't have much time for testing on different devices or brushing things up enough so I'd feel comfortable pushing it to the module directory. But here's the link to the GitHub repo for now:
      InputfieldSlideToggle
      Fieldtype and Inputfield that implements smartphone-style toggles as replacement for checkbox inputs. The visualization is CSS-only, no additional JS necessary.
      Status
      Still very alpha, use with caution!
      Features / Field Settings
      Size
      You can render the toggles in four different sizes: small, medium, large and extra large.
      Off Color
      Currently, "unchecked" toggles can be displayed either in grey (default) or red.
      On Color
      "Checked" toggles can be rendered in one of these colors: blue (default), black, green, grey, orange or red.
      Screenshots

      Some examples with checkbox label


      View all Size and Color Combinations
      Small toggles Medium toggles Big toggles Extra big toggles  









    • By Orkun
      Hi Guys
      I needed to add extended functionalities for the InputfieldDatetime Module (module is from processwire version 2.7.3) because of a Request of Customer.
      So I duplicated the module and placed it under /site/modules/.
      I have added 3 new Settings to the InputfieldDatetime Module.
      1. Day Restriction - Restrict different days based on weekdays selection (e.g. saturday, sunday) - WORKING

       
      2. Time Slots - Define Time slots based on custom Integer Value (max is 60 for 1 hour) - WORKING

       
      3. Time Range Rules per Weekday - Define a minTime and MaxTime per Weekday (e.g. Opening Hours of a Restaurant) - NOT WORKING PROPERLY

       
      The Problem
      Time Slots and Day Restriction working fine so far. But the Time Range Rules per Weekday doesn't work right.
      What should happen is, that when you click on a date, it should update the minTime and maxTime of the Time Select.
      But the change on the select only happens if you select a date 2 times or when you select a date 1 time and then close the datepicker and reopen it again.
      The time select doesn't get change when you select a date 1 time and don't close the picker.
      Here is the whole extended InputfieldDatetime Module.
      The Files that I have changed:
      InputfieldDatetime.module InputfieldDatetime.js jquery-ui-timepicker-addon.js (https://trentrichardson.com/examples/timepicker/) - updated it to the newest version, because minTime and maxTime Option was only available in the new version  
      Thats the Part of the JS that is not working correctly:
      if(datetimerules && datetimerules.length){ options.onSelect = function(date, inst) { var day = $(this).datetimepicker("getDate").getDay(); day = day.toString(); var mintime = $(this).attr('data-weekday'+day+'-mintime'); var maxtime = $(this).attr('data-weekday'+day+'-maxtime'); console.log("weekday: "+day); console.log("minTime: "+mintime); console.log("maxTime: "+maxtime); var optionsAll = $(this).datetimepicker( "option", "all" ); optionsAll.minTime = mintime; optionsAll.maxTime = maxtime; $(this).datetimepicker('destroy'); $(this).datetimepicker(optionsAll); $(this).datetimepicker('refresh'); //$.datepicker._selectDate($(this).attr("id"),date); //$.datepicker._base_getDateDatepicker(); // var inst = $.datepicker._getInst($(this)); // $.datepicker._updateDatepicker(inst); /*$(this).datetimepicker('destroy'); InputfieldDatetimeDatepicker($(this), mintime, maxtime); $(this).datetimepicker('refresh'); */ // $(this).datetimepicker('option', {minTime: mintime, maxTime: maxtime}); } } Can you have a look and find out what the Problem is?
      InputfieldDatetime.zip
       
      Kind Regards
      Orkun
    • By teppo
      This module tracks changes, additions, removals etc. of public (as in "not under admin") pages of your site. Like it's name says, it doesn't attempt to be a version control system or anything like that - just a log of what's happened.
      At the moment it's still a work in progress and will most likely be a victim of many ruthless this-won't-work-let's-try-that-instead cycles, but I believe I've nailed basic functionality well enough to post it here.. so, once again, I'll be happy to hear any comments you folks can provide
      https://modules.processwire.com/modules/process-changelog/
      https://github.com/teppokoivula/ProcessChangelog
      How does it work?
      Exactly like it's (sort of) predecessor, Process Changelog actually consists of two modules: Process Changelog and Process Changelog Hooks. Hooks module exists only to serve main module by hooking into various functions within Pages class, collecting data of performed operations, refining it and keeping up a log of events in it's own custom database table (process_changelog.) Visible part is managed by Process Changelog, which provides users a (relatively) pretty view of the contents of said log table.
      How do you use it?
      When installed this module adds new page called Changelog under Admin > Setup which provides you with a table view of collected data and basic filtering tools See attached screenshots to get a general idea about what that page should look like after a while.
      For detailed installation instructions etc. see README.md.
       


    • By Gadgetto
      Status update links (inside this thread) for SnipWire development will be always posted here:
      2019-08-08
      2019-06-15
      2019-06-02
      2019-05-25
      If you are interested, you can test the current state of development:
      https://github.com/gadgetto/SnipWire
      Please note that the software is not yet intended for use in a production system (alpha version).
      If you like, you can also submit feature requests and suggestions for improvement. I also accept pull requests.
      ---- INITIAL POST FROM 2019-05-25 ----
      I wanted to let you know that I am currently working on a new ProcessWire module that fully integrates the Snipcart Shopping Cart System into ProcessWire. (this is a customer project, so I had to postpone the development of my other module GroupMailer).
      The new module SnipWire offers full integration of the Snipcart Shopping Cart System into ProcessWire.
      Here are some highlights:
      simple setup with (optional) pre-installed templates, product fields, sample products (quasi a complete shop system to get started immediately) store dashboard with all data from the snipcart system (no change to the snipcart dashboard itself required) Integrated REST API for controlling and querying snipcart data webhooks to trigger events from Snipcart (new order, new customer, etc.) multi currency support self-defined/configurable tax rates etc. Development is already well advanced and I plan to release the module in the next 2-3 months.
      I'm not sure yet if this will be a "Pro" module or if it will be made available for free.
      I would be grateful for suggestions and hints!
      (please have a look at the screenshots to get an idea what I'm talking about)
       




×
×
  • Create New...