The My Downloadable Products block has the customer-account-navigation-downloadable-products-link
name:
So, you should use the predicate:
<referenceBlock name='customer-account-navigation-downloadable-products-link' remove='true'/>
See the How to remove «Report Bugs» link from the admin interface article as an example.