Entropy production in systems with random transition rates close to equilibrium