Lifelogging technology is getting attention from industry, academic and market, such as wearable sensors and the concept of smart home. We are proposing a framework which could handle those aggregated multimodal and longitudinal data. The system will take advantage of the rich information carried chronologically and implement process such as data cleaning, low and high level patterns detection and giving feedback to users.