Old Covenant vs New Covenant: Jeremiah 31 Explained
Short answer: The old covenant was the Mosaic law given at Sinai, written on stone and mediated by Moses; it defined sin and promised blessing for obedience but could not change the heart. The new covenant, promised in Jeremiah 31:31-34 and inaugurated by Jesus, is internal, forgiving, and relational: God writes his law on hearts, forgives sin, and brings all his people to know him. Hebrews calls Jesus the mediator of a better covenant enacted on better promises. The old covenant was never wrong; it was preparatory. It exposed sin and pointed forward to the redemption Christ accomplished, so that the new covenant rests not on what we do but on what God in Christ has done.
What Jeremiah 31 Actually Promises
The setting of Jeremiah 31 is exile. The northern kingdom of Israel had already fallen to Assyria, and Judah was facing Babylon. Into that ruin God spoke a promise that was not merely a return to the old arrangement. Jeremiah 31:31 says, “Behold, the days come,” says Yahweh, “that I will make a new covenant with the house of Israel, and with the house of Judah.” The word new here does not mean slightly improved. It means a covenant of a different kind from the one at Sinai. The audience is the whole divided nation, north and south, which signals that this is a restoration promise broader than any single political moment.
The promise is deliberately contrasted with the covenant God made when he brought Israel out of Egypt. That covenant, Jeremiah says, they broke. The failure was not on God’s side. He had been a husband to them, faithful and patient, but they broke the covenant. This is crucial for how we read the rest of Scripture. The old covenant did not fail because the law was bad; it failed because the people were. A covenant written on stone cannot produce the obedience it demands. What is needed is not a better list but a changed heart, and that is exactly what God promises next.
Notice who initiates. God says, I will make. The new covenant is not a bargain struck between equals. It is God’s own act, announced in advance and carried out in his timing. This matches the pattern of the whole Bible: God takes the initiative to rescue a people who cannot rescue themselves. Jeremiah’s original hearers could not manufacture this covenant any more than they could manufacture their own return from exile. It was a promise to be believed and awaited, not a program to be implemented. That should shape how we read every later passage that picks up this text.
There is also a corporate dimension. The covenant is made with a people, not with isolated individuals. God’s work is never merely private. He is forming a community that knows him. This does not erase personal faith; it locates it. Every member of this covenant people, Jeremiah goes on to say, will know the Lord. The new covenant creates the very knowledge of God it requires. That is a radically different foundation from a covenant that depended on each generation’s willingness to keep terms they had already proven unable to keep.
Written on Hearts, Not on Stone
Jeremiah 31:33 gives the defining feature of the new covenant: God will put his law within them and write it on their hearts. In the old covenant, the law was written on stone tablets and stored in the ark. It was external, objective, and good, but it stood over the people as a witness against them. The new covenant does not abolish God’s law; it relocates it. The same God, the same moral will, now inscribed on the inner person. What was outside and resisted becomes inward and embraced.
This is not a promise that obedience becomes automatic, as if believers never struggle. The New Testament still calls Christians to fight sin, to repent, and to grow. But it does promise a new disposition, a heart that has been changed so that God’s will is no longer alien. Ezekiel 36:25-27 makes the same point with different imagery: God sprinkles clean water, cleanses his people, and puts his Spirit within them, causing them to walk in his statutes. The language of heart and Spirit together shows that this is a work of God from the inside out.
This inwardness is why the new covenant can include real forgiveness. Jeremiah 31:34 says God will forgive their iniquity and remember their sin no more. Under the old covenant, sacrifices covered sin but did not perfect the conscience of the worshipper. The new covenant announces a decisive cleansing. Guilt is not merely managed; it is removed. That is why the Lord’s Supper can speak of the cup as the new covenant in Christ’s blood poured out. Forgiveness is not an afterthought; it is the foundation on which heart-obedience rests.
Practically, this means the Christian life is not primarily about external conformity to rules while the heart remains cold. It is about a renewed heart learning to love what God loves. Catechisms and disciplines are useful, but they are not the covenant itself. The covenant is God’s promise to change his people from within. When believers find themselves discouraged by their own inconsistency, the answer is not to try harder in their own strength but to return to the promise: God has written his law on hearts, and he finishes what he starts. That promise is the ground of perseverance, not a license for complacency.
Why the Old Covenant Was Never the Enemy
It is easy to slide into treating the old covenant as a mistake or a failed experiment. Scripture never does. The law is holy, righteous, and good. It came from God, was mediated by angels through Moses, and served a real purpose. It revealed God’s character, defined sin, and set Israel apart as a witness to the nations. Paul insists that the law is not against the promises of God. The problem was never the standard; it was the sinful human heart that could not meet it. The old covenant did its job precisely by showing that the problem is deeper than behavior.
This is why the old covenant functioned like a tutor or guardian. It held God’s people until the promised offspring came. It taught them their need. Every sacrificed lamb, every Day of Atonement, every prophet’s warning was a signpost pointing beyond itself. When Christ came, he did not discard the law; he fulfilled it. He kept it perfectly where Israel and we have failed, and he bore its curse on the cross. The old covenant is not the villain of the story. It is the necessary first act that makes the second act intelligible.
That has pastoral implications. If you read the Old Testament and feel only condemnation, you are reading it partially. It is meant to drive you to Christ, not to leave you in despair. The law’s demands are real, and its diagnosis is accurate: we cannot save ourselves. But the same Bible that gives the law also gives the promise. The old covenant’s limitations are not a reason to despise it but a reason to be amazed at the grace that replaced it with something better. The old was preparatory; the new is permanent.
It also guards us against a common error: thinking that the Old Testament God is harsh and the New Testament God is kind. The God who gave the law is the God who promised the new covenant and sent his Son. His justice and his mercy are not in tension across the testaments; they are revealed together. The cross is where both meet. The old covenant shows us why the cross was necessary; the new covenant shows us what the cross accomplished. Read together, they display one consistent story of a holy God rescuing an unholy people.
Jesus and the Better Covenant
At the Last Supper, Jesus took the cup and said, as Luke 22:20 records, “This cup is the new covenant in my blood, which is poured out for you.” With one sentence, he identified himself as the fulfillment of Jeremiah’s promise. The new covenant was not inaugurated by a new set of laws but by his blood. His death is the covenant sacrifice that secures forgiveness. This is why the New Testament repeatedly calls Jesus the mediator of a better covenant. He does not merely administer the covenant; his own life and death establish it.
Hebrews 8:6 declares that Jesus has obtained a more excellent ministry, since he is the mediator of a better covenant, which has been given as law on better promises. The argument of Hebrews is that the old system, with its repeated sacrifices and human priests, was always pointing forward to a once-for-all sacrifice and a permanent priest. If the first covenant had been faultless, there would have been no need for a second. The very promise of a new covenant in Jeremiah proves that the old was temporary. Its replacement was not an accident; it was announced centuries in advance.
Paul makes a similar point in 2 Corinthians 3, contrasting the ministry of the letter that kills with the ministry of the Spirit that gives life. He is not saying the Old Testament Scriptures are bad. He is saying that a covenant based on external letters cannot produce life; only the Spirit can. The glory of the old covenant, real as it was, fades in comparison with the surpassing glory of the new. This is not a rejection of God’s earlier revelation but a recognition that its purpose has been fulfilled in Christ and its glory surpassed.
Galatians 3:15-29 presses the same logic with the imagery of a will or covenant. Once a covenant is confirmed, no one annuls it or adds to it. Paul argues that the promise to Abraham came before the law, and the law did not cancel the promise. The law was added because of transgressions until the offspring came. Now that faith has come, we are no longer under a guardian. In Christ, the blessing of Abraham comes to the Gentiles, and all who belong to him are heirs according to promise. The new covenant is the fulfillment of the older promise, not its contradiction.
What It Means to Live Under the New Covenant
Living under the new covenant begins with resting in Christ’s finished work rather than in our own record. The covenant is not a contract we maintain; it is a relationship God establishes. Our assurance is not that we have kept every term but that Jesus kept it for us and poured out his blood to secure our forgiveness. Jeremiah’s promise that God will remember our sins no more is not wishful thinking. It is a legal declaration grounded in the cross. When God says he will not remember, he is not forgetting by weakness; he is choosing not to hold our sins against us because they have been paid for.
Because the law is written on our hearts, the Christian life involves a real inward transformation. The Spirit produces love, joy, peace, patience, and the rest. This does not mean sinless perfection in this life. It means a new direction and a new capacity. Believers still sin, but they are no longer slaves of sin. They have a new heart that grieves over sin and turns back to God. The covenant promise does not excuse failure; it provides the remedy for it. Confession and repentance are not covenant-breaking; they are the normal life of people whose hearts belong to God.
Living under the new covenant also means knowing God personally, not just knowing about him. Jeremiah 31:34 says they will all know me, from the least to the greatest. This is not a promise that everyone becomes a theologian but that every member of the covenant community has genuine access to God. No priestly caste stands between ordinary believers and their Father. Through Christ, we have boldness to enter the presence of God. Prayer is not a performance; it is a child speaking to a Father who has already welcomed him. That is the privilege of the new covenant.
Finally, the new covenant gives us a community defined by grace. The old covenant created a nation marked by circumcision, food laws, and temple worship. The new covenant creates a people from every tribe and language, marked by faith in Christ and love for one another. The dividing wall has been broken down. This does not mean doctrine is unimportant, but it means our unity rests on a shared Savior, not a shared ethnicity or ritual. The new covenant is for all who are in Christ, Jew and Gentile alike, and it will never be replaced by anything better, because nothing better exists.
Common Confusions About the Two Covenants
A frequent mistake is to think the old covenant saved people by works while the new covenant saves people by grace. That is not what Scripture teaches. No one was ever saved by law-keeping; Abraham believed God and it was credited to him as righteousness. The old covenant was a national covenant with promises and curses, but salvation was always by grace through faith. The difference is not grace versus works but promise versus fulfillment, shadow versus substance. The old covenant pointed forward; the new covenant delivers what was promised. The same gospel runs through both, though the new covenant reveals it far more clearly.
Another confusion is to imagine the new covenant completely rejects everything in the old. But the new covenant includes the forgiveness and heart-renewal the old promised in seed form. The moral law of God did not change; it is now written on hearts instead of stone. The ceremonial and civil aspects of the old covenant, tied to the land and temple, have been fulfilled in Christ and are no longer binding in the same way. Christians are not under the specific ceremonial regulations of Israel, but they are still called to holiness. The difference is the ground of obedience, not the call to it.
A third error is to treat Jeremiah’s promise as entirely future and having nothing to do with the church era. But the New Testament explicitly applies it to believers now. Hebrews quotes Jeremiah 31 at length and says the new covenant has been established through Christ. Jesus himself inaugurated it at the Last Supper. So while there is a future fullness still to come, the new covenant is already a present reality for all who belong to Christ. We live in the overlap: the covenant is inaugurated but not yet consummated.
Finally, some read the promise that all will know God as meaning no need for teaching or preaching. But the New Testament itself commands teaching and preaching. Jeremiah’s point is not that instruction becomes unnecessary but that every believer now has direct access to God and an inward knowledge that no longer depends solely on external mediators. Teachers still serve the church, but they do not stand between the believer and God. The Spirit teaches every child of God, and the Word preached is one of his primary means. The new covenant produces a people who genuinely know the Lord.
Biblical fidelity check
Jeremiah 31:31-34 establishes that God himself will make a new covenant with Israel and Judah, different from the Sinai covenant, characterized by an inward law, universal knowledge of God among the covenant people, and full forgiveness of sin. It does not establish that the old covenant was evil or that the law of God is abolished. It also does not specify the precise timing of fulfillment beyond indicating a future day. The passage promises; it does not explain the mechanism of atonement, which the New Testament supplies when it identifies Jesus as the mediator whose blood inaugurates the covenant.
A common misreading is that the new covenant is a purely individual, private experience with no connection to God’s covenant people. Jeremiah speaks corporately to the houses of Israel and Judah. Another misreading treats the new covenant as replacing and condemning the Old Testament entirely. But the same God gives both, and the new fulfills the old rather than contradicting it. The error is to set the two testaments against each other as if they revealed different gods or different ways of salvation. Scripture presents one plan of redemption, progressively revealed, centered on Christ, the mediator of a better covenant.
Other passages that speak to Jeremiah 31:31-34
Several related passages deepen this study. Jeremiah 31:31–34 Prophecy: What Is the New Covenant? examines the promise verse by verse in its original setting. Jeremiah 32:36–41 Prophecy: One Heart and an Everlasting Covenant shows the same promise of an inward, lasting covenant. Jeremiah 50:4–5 Prophecy: Israel and Judah Seek the LORD traces the return and seeking language that surrounds the new covenant hope. What Does 1 Corinthians 1:10 Mean? Context, Theology, and Application applies the unity that the new covenant creates among God’s people. Read together, these passages present one consistent story of God’s redeeming work.
Frequently asked questions
Is the old covenant the same as the law of Moses?
Yes, broadly speaking. The old covenant is the covenant God made with Israel at Sinai through Moses, including the moral, ceremonial, and civil laws. It was a real covenant with promises and curses, not merely a set of suggestions. The New Testament refers to it as the first covenant and contrasts it with the new covenant inaugurated by Christ. It was good and God-given, but it was temporary and preparatory, designed to reveal sin and point forward to the Savior who would fulfill it.
Does the new covenant mean Christians can ignore the Old Testament?
No. The Old Testament is still inspired Scripture and profitable for teaching, correction, and training in righteousness. The new covenant fulfills the old; it does not erase it. Christians are not bound by the ceremonial regulations tied to the temple and priesthood, because Christ has fulfilled them. But the moral will of God, summed up in love for God and neighbor, remains. The difference is not whether we obey, but why and how: from a changed heart, by the Spirit, through faith in Christ.
When did the new covenant begin?
The new covenant was inaugurated at the death and resurrection of Jesus. At the Last Supper, Jesus declared the cup to be the new covenant in his blood, poured out for his people. Hebrews speaks of the new covenant as already established through Christ’s mediation. There is also a future dimension: its fullness will be revealed when Christ returns and all God’s people know him perfectly. So Christians live between inauguration and consummation, enjoying the reality now and awaiting its completion.
