In this chapter we delve a little bit deeper into classification. As we mentioned earlier, classification is one of the major areas of data mining and is the ability of the model to categorize data into various groups based on their attributes. This chapter is divided into various sections that explain the usefulness of classification and expose the reader to one of the major ways of creating models. In particular this chapter focuses on decision trees and how they can be created, measured, the limitations encountered and some techniques implemented to help offset these problems.