Well, what you see as matrices (that is the array of numbers) is underneath a function f: N x N -> F
(Where F is a field of your choice, or a ring if you so desire). So its a function that takes two natural numbers (i.e. column and row) and outputs a number.