Earn up to $100 when you refer your friends to Taro Premium. Learn more
Taro Logo

What are the things I should look out for when designing a file storage system?

Profile picture
Anonymous User at Taro Community2 months ago

I am working on a side project. I may use GCP or AWS for it.

tldr of the system : Create a web ui to process input files and generate a tabular output giving the link to the dashboard .

I have a bunch of files generated , about 2GB in size in total , Account ID is the high level directory and inside each account there 50 log files each having specific content .

I want to create a UI using Angular framework . Using the UI I will upload the files to GCS /AWS S3 . Then the backend should trigger complex backend scripts, written will be written in Python or Java and then output file is generated. Using the output file a dashboard with few images embedded is generated.

In the end the UI should have a table which should indicate status of processing to COMPLETE and in another column show point to url of the dashboard.

I want to deal with least amount of security work as I want to avoid studying Oauth 2.0 authentication .

Few additional questions , non-system design questions =>

  1. What are the things I should learn in Angular to cover most bases in this project, I am a backend engineer and going over youtube videos . I want to stick with Angular as I have few work projects going to come in coming months so it will help me to learn it .
  2. I am unfamiliar with typescript . How much effort will it need to learn in order to code for this project. I am most familiar with Python only.
0 Likes
69 Views
2 Comments
👑

Discussion

(2 comments)
  • Alex Chiou
    Robinhood, Meta, Course Hero, PayPal
    2 months ago
    1 Like
  • Rahul Pandey
    Meta, Pinterest, Kosei
    2 months ago
    0 Likes
Taro Footer Icon
Taro Footer Logo

Explore by company

AmazonGoogleMetaMicrosoft

Explore by level

Entry-levelMid-levelSeniorStaff
Taro iOS appTaro Android app
Copyright © Taro