In this paper, some improvements have been made on Articial Bee Colony ABC algorithm to get numerical solutions of both linear and nonlinear dierential equations as initial value problems. The solutions are obtained by a feed-forward neural network trained by the modied ABC.