Make sure that the Import Option Setting for the Import Profile

Allow internal values for dropdown attributes = No

Otherwise what will happen for example is that a Size value of 41 can be associated with a different size (for example: 9). This is because Size 9 has a database (internal) value of 41.