8 Requirements of Intelligence

What is intelligence, in the context of machine learning and AI? A classic from 1979, Hofstadter’s GEB, gives eight essential abilities for intelligence: to respond to situations very flexibly to take advantage of fortuitous circumstances to make sense out of ambiguous or contradictory messages to recognize the relative importance of different elements of a situation …

Continue reading ‘8 Requirements of Intelligence’ »

Why Loss and Accuracy Metrics Conflict?

A loss function is used to optimize a machine learning algorithm. An accuracy metric is used to measure the algorithm’s performance (accuracy) in an interpretable way. It goes against my intuition that these two sometimes conflict: loss is getting better while accuracy is getting worse, or vice versa. I’m working on a classification problem and once again …

Continue reading ‘Why Loss and Accuracy Metrics Conflict?’ »

Spell Out Convolution 1D (in CNN’s)

I’m working on a text analysis problem and got slightly better results using a CNN than RNN. The CNN is also (much) faster than a recurrent neural net. I wanted to tune it further but had difficulties understanding the Conv1D on the nuts and bolts level. There are multiple great resources explaining 2D convolutions, see …

Continue reading ‘Spell Out Convolution 1D (in CNN’s)’ »