Can I create row materials, finished goods and connect them together in quickbooks ?

QBO doesn't offer the assembly feature. Consider having a manufacturing app to integrate with your QBO. Otherwise, switch to QB Desktop US Premier edition. You can still purchase a one time license of it.