How can I create a label encoder utilizing only numpy (and not sklearn LabelEncoder)?

user_8144367 0
Viewed 1169

I am trying to recreate something similar to the sklearn.preprocessing.LabelEncoder

However I do not want to use sklearn or pandas. I would like to only use numpy and the Python standard library. Here's what I would like to achieve:

import numpy as np
input = np.array([['hi', 'there'],
                     ['scott', 'james'],
                     ['hi', 'scott'],
                     ['please', 'there']])

# Output would look like
np.ndarray([[0, 0],
            [1, 1],
            [0, 2],
            [2, 0]])

It would also be great to be able to map it back as well, so a result would then look exactly like the input again.

If this were in a spreadsheet, the input would look like this: enter image description here

scikit-learn pandas numpy python
3 Answers

Here's a simple comprehension, using the return_inverse result from np.unique 

arr = np.array([['hi', 'there'], ['scott', 'james'],
                ['hi', 'scott'], ['please', 'there']])

np.column_stack([np.unique(arr[:, i], return_inverse=True)[1] for i in range(arr.shape[1])])

array([[0, 2],
       [2, 0],
       [0, 1],
       [1, 2]], dtype=int64)

Or applying along the axis:

np.column_stack(np.apply_along_axis(np.unique, 0, arr, return_inverse=True)[1])
user_43333590

Was talking to @Scott Stoltzmann and spit balled about a way to reverse the accepted answer.

One can either carry the original arr along with them through out their program or record the mappings for each column. If you do the latter, here's some simple non-performant code to do so:

l = []

for real_column, encoded_column in zip(np.column_stack(arr), np.column_stack(arr2)):    
    d = {}
    for real_element, encoded_element in zip(real_column, encoded_column):
        d[encoded_element] = real_element
    l.append(d)
print(l)

Doing this with the above yields:

[{0: 'hi', 2: 'scott', 1: 'please'}, {2: 'there', 0: 'james', 1: 'scott'}]

user_19839570

Try this method, which is both beautiful (almost) and optimal:

labels = np.array([['hi', 'there'], ['scott', 'james'],
                   ['hi', 'scott'], ['please', 'there']])

indexes = {val: idx for idx, val in enumerate(np.unique(labels))}
encoded = np.array([indexes[val] for val in labels.flatten()]).reshape(labels.shape)

print(f'Indexes: {indexes}')
print(f'Encoded labels: {encoded}')

The output:

Indexes: {'hi': 0, 'james': 1, 'please': 2, 'scott': 3, 'there': 4}
Encoded labels: [[0 4]
 [3 1]
 [0 3]
 [2 4]]

Enjoy the labels encoder ;)

user_134141330
Related