I am new to ReactJS and I faced the following problem - I have
No, it won't.
It will only rerender the elements that have changed.
Just do it and don't worry -
O(n) is extremely fast.
As pointed out in the comments, if your component is extremely large - you could implement an intermediate one as well.
Here is how React implements the diff algorithm.
Rerender in case of: