Towards the middle of the thirteenth century this manor apparently had come into the possession of Roger son of John de Messeworthe, who before 1290 had alienated it to Adam Aignel. From John son of Adam Aignel the manor descended to his great-grand-son John son of William Aignel, who died in 1361, leaving a son John an infant. His widow Katherine afterwards married Andrew de Bures, and she and her husband occupied the manor during the minority of the heir. While still a minor John married the daughter of Sir John de la Hay. John Aignel held the manor in 1378, and granted a rent from it in 1385-6 to Thomas Peyure. Chauncy states that Sir John de la Hay held a court for this manor in 1375-6, and that he probably left as his heirs two daughters, Alice wife of Robert Whittingham, and Joan wife of Walter Pain, for a court was held for the manor in their names 1401-2. Joan afterwards seems to have married John Impey, for in 1405 John Impey and Joan his wife settled half the manor on themselves and their daughter Joan and her heirs, with remainder in default to Richard Pain and his sisters Isabel and Eleanor, doubtless children of Joan by her first husband. A further conveyance was made by them in 1414 to Walter Salford and others. In consequence of these conveyances an action was brought against John and Joan by Robert Whittingham, who claimed the whole manor. The result of the plea is not gives, but it would seem that Robert made good his claim, for Robert son of Robert and Alice held courts for the manor in the reigns of Henry V and Henry VI. In 1440 Robert Whittingham and Agnes his wife had a grant of free warren in their manor of Pendley, and licence to inclose 200 acres in the parish for a free park. Sir Robert Whittingham was attainted on the accession of Edward IV for adhering to Henry VI, and Pendley was granted in 1461 to George, bishop of Exeter, the king's kinsman, for life. In the same year it was granted for life to Thomas Montgomery, but in 1467 the fee apparently was granted to Henry Bourchier, Lord Cromwell, and his heirs male. In 1469, however, it was granted to George, archbishop of York, and his heirs and assigns.

The king in 1472, in consideration of the good services of Ralph Verney, removed the attainder upon Sir Robert Whittingham, whose daughter and heir Margaret had married Ralph Verney's son John, whereupon Margaret succeeded to Pendley, subject to the life-interest of Thomas Montgomery. John Verney died seised of the manor in right of Margaret, who survived him, in 1505, and was succeeded by his son Ralph Verney, who was subsequently knighted. Sir Ralph died in 1525, leaving his son Ralph a minor. He died in l 556, and the manor came to his son Edmund, a minor at the time of his father's death. The wardship and marriage of Edmund and an annuity from the manor were granted in l547 to Sir Edmund Peckham. Edmund Verney seems to have fallen into disgrace under Queen Mary, and was in 1553 ordered to keep to his house during the queen's pleasure. He died in 1558, without leaving issue, and the manor came to his third brother, Edmund Verney, jun., who died seised of it in 1600, leaving his son Francis a minor. Edmund's second wife Mary survived him, and having persuaded her husband before his death to divide the inheritance between her son Edmund and her stepson Francis, an Act of Parliament was obtained to ratify this, and on the attainment of his majority Sir Francis tried to obtain a reversal of it. He failed to do so, however, and after selling his inheritance he went abroad, and dissipated it. He was an associate of Richard Giffard, captain of a pirate fleet, and died at the Hospital of St. Mary of Pity at Messina in 1615. The manor of Pendley had been sold in 1606-7 by Mary Verney and Sir Francis and Ursula his wife to Richard Anderson, from whom the manor descended in the same way as Wiggington (q.v.)

The estate of Pendley was bought by Mr. Williams, father of the present owner, in 1864, from the Harcourt family. The old manor house stood partly in Tring and partly in Aldbury parish a little to the east of the present house, which is a fine gabled building of red brick faced with stone. In Defoe's Tour Pendley Lodge is spoken of as 'a delightful retirement to a man who wants to deceive life in an habitation which has all the charms nature can give, with a large common rounded by a wood behind it.'

 There are no old court rolls and no courts are held.

In 1506 it was stated that about eighty years before, Pendley was 'a great town, whereof part lay in the parish of Tring and part in the parish of Aldbury. The part in the parish of Tring was held of the archbishop of Canterbury as of his manor of Tring and the part in the parish of Aldbury of the manor of Aldbury, At that time there was no great mansion-house there, but there were in the town above thirteen plows besides divers handicraft men, as tailors, shoemakers and cardmakers with divers others. The town was afterwards cast down and laid to pasture by Sir Robert Whittingham, who built the said place at the west end there as the town sometimes stood, for the town was in the east and south part of the same place,' From further proceedings it seems that Sir Robert Whittingham also ploughed up a common way and in 1491-2 vestiges of the hedges still remained.