Generalized modeling principles of a nonlinear system with a dynamic fuzzy network (DFN)- a network with unconstrained connectivity and with dynamic fuzzy processing units called ‘feurons’, have been given. DFN model has been trained both in open loop and closed loop forms to satisfy these principles. Several system trajectories with a PRBS input have been used for open loop training. DFN model obtained from open loop training was used in a closed loop training with an extended Kalman filter (EKF) in an observer design. For gradient computations adjoint sensitivity method has been used.