Pivot control with large data eats all ram

Stimulsoft Dashboards.WEB discussion
Post Reply
r.bianco
Posts: 75
Joined: Thu Oct 27, 2016 2:06 pm

Pivot control with large data eats all ram

Post by r.bianco »

Hello,

I'm using the trial version of Dashboard.Web to understand if it fits my needs.
I found a problem when using a large data set, about 500.000 rows, the designer hangs trying to extract the data for preview and takes about 6GB of ram.

The data set is really simple: product, location, year, month, quantity, value
I tried with some different controls but the big problem is when I use a Pivot control to be able to see the detailed view with drill down

In rows I want to group by location and product
In colums by year and month

The products are about 14.000, so I'm sure this is the problem

Other controls like a column chart don't have the problem, but I'm not extracting the product itself, only filtering by product

Is there a way to set the controls to lazy-load the data or some other optimization?
Soft System srl
Lech Kulikowski
Posts: 6243
Joined: Tue Mar 20, 2018 5:34 am

Re: Pivot control with large data eats all ram

Post by Lech Kulikowski »

Hello,

Please check the last release build 2019.1.1 which will be available in this week. Were made some optimizations.

Also, in nay cases, all data will be loaded to be able to manipulate them (grouping, summing, filtering etc)

Thank you.
r.bianco
Posts: 75
Joined: Thu Oct 27, 2016 2:06 pm

Re: Pivot control with large data eats all ram

Post by r.bianco »

Great, I'll wait for the new release
Thank you
Soft System srl
Lech Kulikowski
Posts: 6243
Joined: Tue Mar 20, 2018 5:34 am

Re: Pivot control with large data eats all ram

Post by Lech Kulikowski »

Hello,

Please let us know about the result.

Thank you.
r.bianco
Posts: 75
Joined: Thu Oct 27, 2016 2:06 pm

Re: Pivot control with large data eats all ram

Post by r.bianco »

I tried the new release and I noticed the improvements when filtering the data set, even with data aggregation done in the charts instead of a dedicated query, really good! (chars with pre-aggregated data are instantly loaded)
The pivot is still unusable with 500.000 records and uses 6GB of ram before crashing
It might be solved by not loading the details but asking to select what you need to see through the filters, but I didn't find a way to start with empty filters
Dashboard_filters.PNG
Dashboard_filters.PNG (6.25 KiB) Viewed 3509 times
If is possible to set the filters as "select all" or "select none" on design time it would be really nice, if it's already possible and I'm missing the point then I might need more advanced tutorials :D

Thank you
Soft System srl
Lech Kulikowski
Posts: 6243
Joined: Tue Mar 20, 2018 5:34 am

Re: Pivot control with large data eats all ram

Post by Lech Kulikowski »

Hello,

We have added some optimizations for Pivot component also, will be available in the next build.

Thank you.
r.bianco
Posts: 75
Joined: Thu Oct 27, 2016 2:06 pm

Re: Pivot control with large data eats all ram

Post by r.bianco »

Ok, I'll wait for the next build.
Thank you!
Soft System srl
Andrew
Posts: 4104
Joined: Fri Jun 09, 2006 3:58 am

Re: Pivot control with large data eats all ram

Post by Andrew »

Hello,

The next build will be in January.

Happy New Year!
r.bianco
Posts: 75
Joined: Thu Oct 27, 2016 2:06 pm

Re: Pivot control with large data eats all ram

Post by r.bianco »

Hello,

when will the next build be available?

Thank you
Soft System srl
Lech Kulikowski
Posts: 6243
Joined: Tue Mar 20, 2018 5:34 am

Re: Pivot control with large data eats all ram

Post by Lech Kulikowski »

Hello,

We will try to release new build on this week.

Thank you.
Post Reply