This volume represents a radical departure from the current philosophical duopoly in the area of foundations of probability, that is, the frequency and subjective theories. One of the main new ideas is a set of scientific laws of probability. The new laws are simple, intuitive and, last but not least, they agree well with the contents of current textbooks on probability. Another major new claim is that the "frequency statistics" has nothing in common with the "frequency philosophy of probability," contrary to popular belief. Similarly, contrary to the general perception, the "Bayesian statistics" shares nothing in common with the "subjective philosophy of probability."The book is non-partisan on the scientific side -- it is supportive of both frequency statistics and Bayesian statistics. On the other hand, it contains well-documented and thoroughly-explained criticisms of the frequency and subjective philosophies of probability. Short reviews of other philosophical theories of probability and basic mathematical methods of probability and statistics are incorporated. The book includes substantial chapters on decision theory and teaching probability, and it is easily accessible to the general audience.