The reason is that "Jehovah" (or any transliteration) does belong there, and in these specific cases, the replacement would sound strikingly incorrect.
Exo 6:3: And I appeared unto Abraham, unto Isaac, and unto Jacob, but the Name of God Almighty, but by my name LORD was I not knowen to them
If both occurences were to be understood as "title", "authority", then the phrase would sound very incorrect. Thus, the correct interpretation is to treat "the name" as title, but "my name" as God's personal name:
And I appeared unto Abraham, unto Isaac, and unto Jacob, but the Name of God Almighty, but by my name Jehovah was I not knowen to them
Psa. 83:18: That men may knowe, that thou, whose name is Jehovah, art the most high over all the earth
sounds much more reasonable than
That men may knowe, that thou, whose name is Lord, art the most high over all the earth
Isa. 12:2:, Isa. 26:4:
for the Lord Jehovah is my strength.
Well, you just can't say "Lord Lord" here, and it's very hard to hide the fact that the original text uses a personal name here. Different translations used phrases like "Lord, the Lord himself"[NIV], "Lord God" or "GOD the LORD"
Now: The original says "יָהּ יְהוָה"("Yah Yehwah"), so the most correct translation could be along the lines of "Jah, Jehovah" - showing Isaiah's very deep relation to his God, Jehovah:
Look! God is my salvation. I shall trust and be in no dread; for Jah Jehovah is my strength and [my] might, and he came to be the salvation of me. -- Is.12:2 [New World Translation of the Holy Scriptures]
Now, the correct question is: why did the translators have such a rule in the first place? Why not translate יְהוָה as Jehovah or Jahveh?
Judaism 101 says:
Jews do not casually write any Name of God. This practice does not come from the commandment not to take the Lord's Name in vain, as many suppose. In Jewish thought, that commandment refers solely to oath-taking, and is a prohibition against swearing by God's Name falsely or frivolously (the word normally translated as "in vain" literally means "for falsehood").
Judaism does not prohibit writing the Name of God per se; it prohibits only erasing or defacing a Name of God. However, observant Jews avoid writing any Name of God casually because of the risk that the written Name might later be defaced, obliterated or destroyed accidentally or by one who does not know better.
The commandment not to erase or deface the name of God comes from Deut. 12:3. In that passage, the people are commanded that when they take over the promised land, they should destroy all things related to the idolatrous religions of that region, and should utterly destroy the names of the local deities. Immediately afterwards, we are commanded not to do the same to our God. From this, the rabbis inferred that we are commanded not to destroy any holy thing, and not to erase or deface a Name of God.
...
The Mishnah confirms that there was no prohibition against pronouncing The Name in ancient times. In fact, the Mishnah recommends using God's Name as a routine greeting to a fellow Jew. Berakhot 9:5. However, by the time of the Talmud, it was the custom to use substitute Names for God. Some rabbis asserted that a person who pronounces YHVH according to its letters (instead of using a substitute) has no place in the World to Come, and should be put to death. Instead of pronouncing the four-letter Name, we usually substitute the Name "Adonai," or simply say "Ha-Shem" (lit. The Name).
...
(link, emphasis added)
Related: Should the Name Jehovah Appear in the New Testament?
