LWC Datatable LDV, Christian Knapp & Christian Menzinger

Interactive data-tables are awesome and a challenge – LWC’s lightning-datatable is no exception. It has many, useful features, lots of documentation and can handle various use cases from working with single fields to several records.

Loading Salesforce records with a fixed set of fields and a fixed set of column labels is straightforward and quickly done.

What about the next level, though? Loading a related list for example? Sortable. Searchable. Displaying the table in the user’s end language, with translated columns and values, too, where supported. Scanning a Large Data Volume like 70.000 records.

This talk will not provide a solution. It will focus on the path to a possible solution: Given all these requirements, where do I start? Where and how do I get test records? And 70k! Should sorting happen in the datatable or should Apex do the lifting? Which APIs do I use? When? How often? Where? Why?

Join us for a bit of code and lots of serious, honest experience sharing.

1. Having serious fun with LWC Datatable and Large Data Volume by Christian Szandor Knapp & Christian Menzinger

2. About us Christian Menzinger Salesforce Architect, Copado @chris_menzinger https://www.linkedin.com/in/christianmenzinger Christian Szandor Knapp Head of Development, appero @ch_sz_knapp https://www.linkedin.com/in/szandor

3. Chapter I - In a Land far, far away Chapter II - Trails for Rangers, Crossroads for Heroes Chapter III - The mole’s tale - Summer is coming Chapter IV - The dwarf’s tale - We dig, dig, dig, dig, dig, dig, dig Running out of time Q&A Your F airytale Today

4. Chapter ~ I ~

5. In a Land far, far away

6. … there was a charming product owner princess Once upon a time, in a land far, far away …

7. … and two innocent developers. (Full Hair) (Beard) (Hat)

8. They were working happily together

9. We have a need, she said. It is going to be beautiful, she said. It will be so much fun to build, she said. We use base components, she said. Until one day …

10. A meeting, two days before … His dog, Franz K., Architect Herr Governor Limit Karl, 4th Gen CEO Inherited an Empire (Pricebook)

11. “This is our idea”, princess said

12. “Find products by tabular search”, princess said

13. Franz, the Architect (sometimes a little too busy) We always empower Admins. Have them configure a List View on Product2. Use the List View to define the table. By the way, a Pricebook has 1.500.000 products per currency. Could get a lot more very quickly.

14. We have a long standing SAP business relationship. Picklist Values/Keys on Product2 are internal to SAP Picklist Labels give User Guidance Use localized Picklist Labels Make sure fields like Term (12, 24, 36) can be searched. Karl, the Boss (Trailhead Ranger, Part Time Admin)

15. “Here are a few pointers for you”, princess said

16. Questions? Any elephants in the room? For example: Are we rebuilding Standard Product Search on Opportunity? Is this a good idea?

17. Chapter ~ II ~

18. Trails for Rangers, Crossroads for Heroes

19. Front End / LEX (Base Components) Backend (Apex) Front End / LEX (Wire Adapters) Project Setup (e.g. Test Data) Where to next? Agile or Waterfall? Backend (sObjects)

20. Forward Looking Statement

21. Official cause of death Governor Limit RIP You died Invalid Type Coercion Platform Restrictions Fuzzy (Ideas about) Requirements Racing Conditions / Flags Performance Issues currently in Beta or Deprecated

22. Chapter ~ III ~

23. The mole’s tale Summer is coming

24. Documentation https://developer.salesforce.com/docs/component-library/bundle/lightning-datatable/documentation Examples and useful Snippets https://github.com/trailheadapps/lwc-recipes https://github.com/trailheadapps/apex-recipes )* in comparison to the start of Aura** )** Aura today and all Salesforce Docs are in a much more accessible state than most other docs Excellent state of LWC documentation*

25. He’s a curious and crafty krtek I’m off building a tiny Proof of Concept I’m back in an hour

26. He’s a curious and crafty krtek I will Set up a Scratch Org with s ample data using VS Code Pump it full of products Create LWC Use LWC Local Development for fast prototyping Use Wire Adapter to load list view and records! I used that last year

27. Official cause of death RIP You died Platform Restrictions Racing Conditions / lags currently in Beta or Deprecated

28. Official cause of death RIP You died again Platform Restrictions Racing Conditions / lags currently in Beta or Deprecated Needs a higher API version than supported by LWC Local Development

29. First Demo

30. Forward looking statement RIP You died Performance Issues

31. A Scratch Org comes with <30 Products Use Open Source tools for data Snowfakery Config / CumulusCI:

32. Death by Platform Restriction / Limits? Use Open Source Tools for Data Snowfakery Config / CumulusCI:

33. SUMMER IS COMING

34. Here’s what we’ve learned A lot about client side performance Why Summer 22 will make it better Why Selections need special care Why there are no shortcut/s via Listview APIs Decisions No data, no table, no columns, no table To talk to Apex we need to know which fields to query first Use getListInfoByName() Salesforce Fields are also columns Columns need type information E.g. Booleans should render as a checkboxes Use getObjectInfo()

35. Although we called it “Tabular Product Search” It is not Products we are looking for but PricebookEntries Official cause of death RIP You died Fuzzy (Ideas about) Requirements

36. Official cause of death RIP You died again Platform Restrictions PricebookEntries Do Not Support ListViews

37. Official cause of death RIP You almost died a 3rd time Racing Conditions / Flags Wire Adapters a re supported only in @wired decorated properties/function No Promise.all() available

38. Official cause of death Governor Limit RIP You died a 3rd time Performance Issues currently in Beta or Deprecated

39. Here’s what we’ve learned Loading fewer records is always better for performance Use infinite loading Use offsets to avoid query limits for LDV Use a record limit / threshold for rendered rows in table Have we talked about sorting yet? String.prototype.localeCompare() Or Apex?

40. Sorting should work exactly like in Salesforce We sort things all of the time in reports or list views Of course …

41. “This should be simple ”, princess said

42. Here’s what we’ve learned Loading fewer records is always better for performance Use infinite loading Use offsets to avoid query limits Use a record limit / threshold for rendered rows in table Apex does the sorting Works good within caching Needs a bit of loading otherwise

43. Summary I LWC provides Offsets Limits Search Term SortedBy Field and Sort Direction LWC is responsible for Providing Initial Data for Apex Query e.g. Field Names Talking to Apex Debouncing Selection Handling Data Wrangling Data Table does not support Contact.Account.Name

44. Chapter ~ IV ~

45. The dwarf’s tale We dig dig dig dig dig dig dig

46. The actual Fairytale (Query based on String Inputs) (Large Data Volume) (Strongly Typed)

47. Official cause of death Invalid Type Coercion Fuzzy (Ideas about) Requirements RIP You died Platform Restrictions

48. Should you know the dwarf…

49. Where Clauses and not yet dynamic SOQL

50. Official cause of death RIP You died Platform Restrictions RIP You died

51. Finally…

52. Summary II Dig, Dig, Dig, Dig, Dig, Dig, Dig Not all field types can / will be supported for text search (Idea) specialised search fields for e.g. date All supported types need to be converted for queries Product2.Description is a special snowflake (Idea) SOSL for long text fields (Challenge) combine User Experience

53. Summary II Will we meet Large Data Volume Trouble? No due to tight LIMIT clauses Rules differ for standard and custom indices Standard Index Total # of records is < 1M: Query must return less than 30% of total Total # of records > 1M: Query must return <300K rows Custom Index 10% of total records and < 10k rows

54. ~ OPEN END ~

55. Architectural Mindset: keep asking questions Challenge “simple-use-case” documentation Commit early, commit cleanly, commit often Handling events as they come out of the box is not always the whole truth Product2, PricebookEntry do not count against record limit Inserting 1.5m records is easy, LDV Selective Query Limits are not. Huge Gains in Summer 22 for Datatable Render Performance Random Collection of Take-Aways

56. ~ RESOURCES / LINKS~

57. “ LWC Utils” by tsalb Includes a Salesforce-Records-To-Datatable Component https://github.com/tsalb/lwc-utils CumulusCI https://trailhead.salesforce.com/en/content/learn/trails/build-applications-with-cumulusci Apex and LWC Recipes https://github.com/trailheadapps/lwc-recipes https://github.com/trailheadapps/apex-recipes Demo Repository for 1.5M Products/PricebookEntries & a simple datatable https://github.com/Szandor72/cd22 - lightning-datatable Resources / Links - all Open Source

58. ~ Q & A ~

59. a ppero GmbH is hiring a new Head of Development Thank you for 5+ amazing years Wanna wear my hat?