9 million Rows in Excel

Hi,
i got an 9 million row excel file and i need to join it with another excel file base on numeric values.

Issue :

I suppose to have only unique numbers in column A, but unfortunately i got some characters in some columns.

When i try to join the two excel i get an error : dataFormat.Error: We couldnt convert number.

How can i :
1. delete rows where i got alphanumeric values in columns
2. filter out alphanumeric - powerbi, excel or any other software

Thank you