I am currently doing the same thing in our company. We are configuring B2C Direct between all our offices around the world and each one has their own tenant.
It sounds like you are on the correct path. You next step is to use Cross tenant Synchronization
We were able to choose what users can be synced and the other tenant users can be synced.
FYI: Our requirements was that the external users are managed by their home tenant and they use their own licenses from their home tenant.
This also got rid of a lot of little annoying little problems.
Another cool thing is that in this sync scenario, if the external user leaves and their profile is deleted from their home tenant is also deletes it on your end.
The way you are doing it means you are having to insert their name, last name, email and so on and so on.
By using sync, you select the users from the external tenant to be added as an external Member and then it just adds it. No need to type out all their info. Its so much quicker.
You can up to 5 users at a time.
To answer your question. No you cant import with a .CSV. However, my method means you can add like 20 users in the time your take to add one user manually.
Hope this helps.