Data Partitioning, Can more than 1 partition be loaded?

[Rosemary_Black]

Can I create a partitioning expression to load more than 1 partition for some users?

[Grant_Stead]

I don’t believe so.

[Rosemary_Black]

How would you handle an administrative view that would need to see combined data?

[Grant_Stead]

I’m going to assume there is some reason that you can’t have it all in one table, such as smartsheet limitations…

You would have a table that lists the partitions, and either of the following:
You could have an admin app that has each of the partitions, loaded up as separate data sources… And virtual columns running calculations for the partition table.
Or, you could have something happening in the back end, that goes fetches the calculated data.

I would challenge you to consider your data modeling that is requiring you to partition your data.

[Rosemary_Black]

I haven’t set up any partitions yet, trying to decide the best course of action for what will become an increasingly large amount of data.

[Grant_Stead]

According to Praveen.
A legit SQL database, with security filters is all you need. The security expressions are pushed to the SQL side so they’re fast

[Grant_Stead]

Another option is levels of archival. With the new add a row feature, we can “duplicate” records as they’re created and modified. This provides the capability to have aggressive archiving for data sets that certain users will use most often, and then have an archival view that the user can switch to via user settings… (Which can be handled via data partitions…)

Point is, if everyone has the right & need to see all the data at one time or another, and your data source isn’t constrained, there’s no reason not to just load down with millions of records…