it felt that way at first for me but I just needed to get used to it. Im using the sword and a dagger, with the sword on fire and the dagger on earth which gives you a nice little damage causing barrier you can use as your dual skill.. I have the toughness glyph, and the elemental, burning, speed, and storm. I have my specialties or whatever they are called on fire, lightning and tempest. Im just one barring it right now because of the pause in changing elements, waiting for the other one I want. Ive been mostly soloing everything, and i just hit 80 this week so I am not all that geared. I mean I die occasionally but frankly its a good change to ESO where I pretty much just two shot mobs. Just always be moving and use dodge. Let the elemental take the first shot so first aggro is on it. There are a few fights I did have to use a staff on but the staff is pretty underwhelming sadly. I used daggers through 80, its so bad, but I have it on my backbar. I really wish they would give us weapon swap. I get we have elemental swap but it would give us survivability in a fight where we could kite out of range and swap and go back in.
Im not saying its good enough for pvp or even raiding but if youre mostly doing in world and story quests, with story quests and most in world I use the sword and dagger, in bigger group fights I swap to staff. Its definitely ok for all that stuff. Im doing my story and world stuff on that because its always going to be my favorite, hence the name, in any mmo but I will probably role out something else when I am ready to raid and stuff. I have to admit i havent done any dungeons yet even on story mode. But i am not having problems on the fights in the story. with my mismatched gear I have 13600 or something health. If I know I am going to have problems in a fight I eat some vitality food.