The efficiency of the transport system depends on the planning and control strategies applied. The satisfaction of both the operator and the passenger in transport systems is challenging and determines the level of efficiency of the system. To decrease unnecessary traveled time by passengers, stop skipping control strategy is used to deal with this problem. Because of the NP-Hardness of the problem, a meta-heuristic algorithm is proposed for the optimal bus scheduling problem. The algorithm determines a selection of bus stops to be served by each bus from a set of potential stops. The goal is to serve all the passengers waiting at stops by minimizing the total delay (service time). Metaheuristics and RL techniques are applied to test our approach.