New probability models are proposed for the analysis of marked point processes. These models deal with the type of data that arrive or are observed in possibly unequal time intervals such as financial transactions, earthquakes among others. The models treat both the time between event arrivals and the observed marks as stochastic processes. We adopt a class of bivariate distributions to form the bivariate mixture transition distribution(BMTD). In these models the conditional bivariate distribution of the next observation given the past is a mixture of conditional distributions given each one of the last p observations or a selection of past p events. The identifiability of the model is investigated, and EM algorithm is developed to obtain estimates of the model parameters. Simulation and real data examples are used to demonstrate the utility of these models.