Page 1 of 1

Pivot control with large data eats all ram

Posted: Fri Dec 14, 2018 8:23 am
by r.bianco
Hello,

I'm using the trial version of Dashboard.Web to understand if it fits my needs.
I found a problem when using a large data set, about 500.000 rows, the designer hangs trying to extract the data for preview and takes about 6GB of ram.

The data set is really simple: product, location, year, month, quantity, value
I tried with some different controls but the big problem is when I use a Pivot control to be able to see the detailed view with drill down

In rows I want to group by location and product
In colums by year and month

The products are about 14.000, so I'm sure this is the problem

Other controls like a column chart don't have the problem, but I'm not extracting the product itself, only filtering by product

Is there a way to set the controls to lazy-load the data or some other optimization?

Re: Pivot control with large data eats all ram

Posted: Sun Dec 16, 2018 8:52 am
by Lech Kulikowski
Hello,

Please check the last release build 2019.1.1 which will be available in this week. Were made some optimizations.

Also, in nay cases, all data will be loaded to be able to manipulate them (grouping, summing, filtering etc)

Thank you.

Re: Pivot control with large data eats all ram

Posted: Mon Dec 17, 2018 8:03 am
by r.bianco
Great, I'll wait for the new release
Thank you

Re: Pivot control with large data eats all ram

Posted: Mon Dec 17, 2018 10:12 am
by Lech Kulikowski
Hello,

Please let us know about the result.

Thank you.

Re: Pivot control with large data eats all ram

Posted: Fri Dec 21, 2018 8:01 am
by r.bianco
I tried the new release and I noticed the improvements when filtering the data set, even with data aggregation done in the charts instead of a dedicated query, really good! (chars with pre-aggregated data are instantly loaded)
The pivot is still unusable with 500.000 records and uses 6GB of ram before crashing
It might be solved by not loading the details but asking to select what you need to see through the filters, but I didn't find a way to start with empty filters
Dashboard_filters.PNG
Dashboard_filters.PNG (6.25 KiB) Viewed 5225 times
If is possible to set the filters as "select all" or "select none" on design time it would be really nice, if it's already possible and I'm missing the point then I might need more advanced tutorials :D

Thank you

Re: Pivot control with large data eats all ram

Posted: Sat Dec 22, 2018 12:51 pm
by Lech Kulikowski
Hello,

We have added some optimizations for Pivot component also, will be available in the next build.

Thank you.

Re: Pivot control with large data eats all ram

Posted: Thu Dec 27, 2018 10:13 am
by r.bianco
Ok, I'll wait for the next build.
Thank you!

Re: Pivot control with large data eats all ram

Posted: Thu Dec 27, 2018 12:57 pm
by Andrew
Hello,

The next build will be in January.

Happy New Year!

Re: Pivot control with large data eats all ram

Posted: Mon Feb 04, 2019 11:10 am
by r.bianco
Hello,

when will the next build be available?

Thank you

Re: Pivot control with large data eats all ram

Posted: Mon Feb 04, 2019 9:16 pm
by Lech Kulikowski
Hello,

We will try to release new build on this week.

Thank you.