Sunday, January 8, 2023

Dealing with 20M records in Tableau (CTe,Temptable & Empty extract)

--Tableau Handling Large dataset. 

Dealing with 20M records in Tableau 

  • Create a Temp table to hold the data and to store the intermediate result in INITIAL SQL & load the data to TEMP Table.
  • doo the calculation on the top of that temp table in the Tableau Custom SQL.
  • Create an Empty extract on top of it 
  • Publish the Data source  & refresh on the tableau server level only.


Empty extract

  • Create a Boolean paramter 
  • Create the workbook 
  • Make a calculated field on the top of that parameter
  • Show the parameter and select True
  • Create a extract by adding that calcualted field as exculding the True 
  • You can check the no of records in the workbook is ZERO AND Now you have zero extract ready 
  • Now make the parameter to False so that the the condition will True (True exculde in the Extract filter & Parameter will select False)
  • Now publish the data source on the tableau server.
  • Refersh over the tableau server.
  • We can connect that datasource to get all the data.


No comments:

Post a Comment

"๐Ÿš€ Delta Lake's Vectorized Delete: The Secret to 10x Faster Data Operations!"

"๐Ÿš€ Delta Lake's Vectorized Delete: The Secret to 10x Faster Data Operations!" Big news for data engineers! Delta Lake 2.0+ in...