Oh aye, that's very true.
If we knew we could open up society and, via whatever means, keep COVID deaths at a couple of hundred per week, then those deaths, at a national level as opposed to a personal level, would get lost in the noise of 550 to 600k deaths a year.
But, to get to that point we need treatments, probably of broadly two kinds. One which can save the vast majority of people getting hospitalised who are currently dying, and another to treat people before they need hospitalising ( to ensure we have enough beds and staff to cope with both COVID and day to day stuff ).
Until we get those, and/or a safe, efficient vaccine, then some restrictions will be needed, and the above focuses purely on deaths and ignores non-fatal life changing complications.