Hello Everyone,
Material table has 1.2Million entries but system is considering only 1million records for profiling. Is that expected behavior or do we need to change any settings to consider additional records?
1 million is the limit set by the product and this is only configurable at the region or service level not within an individual tenant or specific system or object.
Hi Ravi,
Have you done profiling on the staged copy of data? can you check if any filters are applied when extracting material table from source?
Regards,
Rakesh
Hi Rakesh,
Yes I did profiling on staged data and we applied some basic filters. Does system considers only 1mil records for profiling?
I believe there are limits set by product team on the profiling record counts, this is to ensure we don't consume all resources. Please see my other post on profiling intent and context, and I hope that makes more sense within that. You should have the full ability to create and publish reports based on the source data as part of assessing, reporting in context of the mapping and relevance exercises. Keep in mind profiling is your (data team) initial view of the data that is going to the next step of assessment. You could potentially log a support ticket for this to see what the possibilities of increased volumes are for profiling.
Please sign in to leave a comment.
Comments
4 comments