The simple recurrent network (SRN or Elman net) was shown to be able to learn disposition of syntactic categories of complex sentences with relative clauses in declarative sentences (Elman, 1991). However, it has not been known whether SRN can learn disposition of syntactic categories of more complex sentence grammer like interrogative sentences and recognize case of the words in the sentences. In this paper, we show the recurrent network is able to predict the next word in interrogative sentence and assign the case of nouns.