635. Design Log Storage System
Problem Description
The given LeetCode problem involves creating a log system that can store log entries with a unique ID and timestamp, and then retrieve logs that fall within a given time range based on varying levels of granularity. A timestamp in this problem is given in the string format "Year:Month:Day:Hour:Minute:Second", where each part of the date-time is zero-padded. The system needs to support two operations:
-
put(int id, string timestamp): This function takes a log entry's unique ID and its timestamp, then stores it in the system.
-
retrieve(string start, string end, string granularity): This method returns the list of log IDs that have timestamps within the inclusive range specified by
start
andend
. The granularity parameter determines how precise the time range should be, ranging from the year down to the second. The granularity truncates the timestamp to the specified level of detail, and only that level of detail is considered when filtering logs.
For example, if the granularity is "Day", then the logs are filtered based on their year, month, and day, without considering hours, minutes, or seconds.
Intuition
The intuition behind the solution involves storing the log entries efficiently so that they can be easily retrieved based on time range queries with varying granularities. To retrieve the correct logs, we need to compare only the parts of the timestamps that are relevant to the specified granularity. The solution defines a dictionary d
that contains the cutoff indices for each granularity. These indices are used to truncate the timestamp strings to the required precision.
The retrieval function takes advantage of Python's string comparison, which can be used directly on the truncated timestamp strings. Since the timestamps are fixed-length and zero-padded, lexicographical comparison of the strings works equivalently to comparing the numerical values.
Here's the thought process for arriving at the solution approach:
-
Store all logs in a list as they are received. There's no need to sort them since we can filter them during retrieval.
-
Define a dictionary that maps each granularity to the index up to which the timestamp should be considered. For instance, if the granularity is "Year", we only consider the first four characters of the timestamp.
-
When retrieving logs within a specific range, determine the cutoff index for the timestamps based on granularity. Use slicing to truncate the
start
,end
, and current log timestamp to the relevant precision. -
Iterate through all stored logs, compare the truncated timestamp of each log to the truncated
start
andend
timestamps, and filter accordingly. -
Return the list of IDs of the logs that satisfy the range and granularity criteria.
By following this approach, we ensure that we can efficiently retrieve the correct log entries without the need for complex date-time parsing or conversion.
Solution Approach
The implementation of the LogSystem
class involves two key methods: put
and retrieve
.
The put
method is straightforward. Each call to put
adds a tuple consisting of the id
and timestamp
to the logs list:
def put(self, id: int, timestamp: str) -> None:
self.logs.append((id, timestamp))
Here we don't need to worry about sorting or the position of the log entry because the retrieval will handle the search based on the timestamp.
The retrieve
method does the main work of filtering the log entries according to the provided time range and granularity:
def retrieve(self, start: str, end: str, granularity: str) -> List[int]:
i = self.d[granularity] # Find the index up to which we should compare timestamps
return [id for id, ts in self.logs if start[:i] <= ts[:i] <= end[:i]]
The use of dictionary d
to store the indices for each granularity level allows us to easily retrieve the correct substring length to compare. For example, for granularity Year
, d['Year']
would be 4, so start[:4]
would give us the year component of the start
timestamp.
A comprehensive breakdown of the algorithm used:
-
Upon initialization (
__init__
), an empty listlogs
is created to store the log entries. A dictionaryd
is also initialized to map granularity to corresponding substring indices. -
The
put
method simply appends the provided log entry to thelogs
list without any additional processing. -
The
retrieve
method calculates the indexi
up to which the timestamps should be considered, based on the granularity. It uses list comprehension to iterate through all the stored logs and includes the ones that match the range condition. -
For each log, the comparison is done by slicing the timestamps of the logs and the provided
start
andend
parameters up to indexi
. This way, we only compare the parts of the timestamps that matter for the specified granularity. -
We rely on Python's string comparison to compare the sliced timestamps. Since timestamps are zero-padded and have a consistent format, this works out as effectively as numerical comparison.
-
The method finally returns a list of IDs whose timestamps fall within the specified range.
This implementation is efficient as it separates the storage and querying of log entries. The dictionary d
effectively eliminates complex parsing or time conversion by using string slicing based on predefined indices corresponding to each granularity.
Ready to land your dream job?
Unlock your dream job with a 2-minute evaluator for a personalized learning plan!
Start EvaluatorExample Walkthrough
Let's say we instantiate a LogSystem
and perform a series of put
and retrieve
operations as per the solution approach described.
First, we add a few logs to the system with varying timestamps:
logSystem = LogSystem() logSystem.put(1, "2017:01:01:23:59:59") logSystem.put(2, "2017:01:02:23:59:59") logSystem.put(3, "2017:02:01:23:59:59")
In our logs data structure, we now have:
[(1, "2017:01:01:23:59:59"), (2, "2017:01:02:23:59:59"), (3, "2017:02:01:23:59:59")]
No sorting is needed; we just store the logs as they come.
Suppose we want to retrieve logs with timestamps in January 2017; we can call the retrieve
method accordingly:
results = logSystem.retrieve("2017:01:01:00:00:00", "2017:01:31:23:59:59", "Month")
The d
dictionary in the LogSystem
has an entry "Month": 7
, indicating that we should compare the timestamps up to the seventh character for a "Month" granularity, which corresponds to the year and month components.
The retrieve
method will:
-
Determine the index
i
for month granularity, which is7
. Thus, we will compare timestamps up to"2017:01"
. -
Iterate through the logs:
- For log (1, "2017:01:01:23:59:59"), the truncated timestamp is "2017:01" which is within the range "2017:01" to "2017:01". - For log (2, "2017:01:02:23:59:59"), the truncated timestamp is also "2017:01", which is within the range. - For log (3, "2017:02:01:23:59:59"), the truncated timestamp is "2017:02", which is outside the range.
- Create a list of the IDs where the condition holds true. In this case, logs 1 and 2 match, while log 3 does not.
As a result, results
will have the value [1, 2]
, meaning log entries with IDs 1 and 2 are the ones that fall within the desired time range and granularity.
This example demonstrates how the implementation allows us to efficiently filter logs based on a specified granularity and time range without complex parsing.
Solution Implementation
1class LogSystem:
2 def __init__(self):
3 # Initialize logs list to hold all the log entries as tuples (id, timestamp)
4 self.logs = []
5
6 # Dictionary to map the granularity level to the index of timestamp string
7 self.granularity_to_index = {
8 "Year": 4, # Index where the Year value ends in the timestamp
9 "Month": 7, # Index where the Month value ends in the timestamp
10 "Day": 10, # Index where the Day value ends in the timestamp
11 "Hour": 13, # Index where the Hour value ends in the timestamp
12 "Minute": 16, # Index where the Minute value ends in the timestamp
13 "Second": 19, # Index where the Second value ends in the timestamp
14 }
15
16 def put(self, log_id: int, timestamp: str) -> None:
17 # Store the log with its id and timestamp
18 self.logs.append((log_id, timestamp))
19
20 def retrieve(self, start: str, end: str, granularity: str) -> list:
21 # Find the index up to which we will compare timestamps based on the granularity
22 index = self.granularity_to_index[granularity]
23
24 # Retrieve log_ids of logs where timestamp is within the start and end range,
25 # sliced according to the granularity level
26 return [log_id for log_id, ts in self.logs if start[:index] <= ts[:index] <= end[:index]]
27
28# Example of how to use the LogSystem class
29# obj = LogSystem()
30# obj.put(log_id, timestamp)
31# results = obj.retrieve(start, end, granularity)
32
1import java.util.ArrayList;
2import java.util.HashMap;
3import java.util.List;
4import java.util.Map;
5
6// Class representing a system to store and retrieve logs based on time granularity
7class LogSystem {
8
9 // A list to store all logs
10 private List<LogEntry> logEntries = new ArrayList<>();
11
12 // A map to store the length of the timestamp string
13 // based on the granularity
14 private Map<String, Integer> granularityMap = new HashMap<>();
15
16 // Constructor for initializing the granularity map
17 public LogSystem() {
18 granularityMap.put("Year", 4);
19 granularityMap.put("Month", 7);
20 granularityMap.put("Day", 10);
21 granularityMap.put("Hour", 13);
22 granularityMap.put("Minute", 16);
23 granularityMap.put("Second", 19);
24 }
25
26 // Method to store an individual log entry
27 public void put(int id, String timestamp) {
28 logEntries.add(new LogEntry(id, timestamp));
29 }
30
31 // Method to retrieve log entries within the start and end
32 // timestamp based on the given granularity
33 public List<Integer> retrieve(String start, String end, String granularity) {
34 List<Integer> result = new ArrayList<>();
35 int granularityLength = granularityMap.get(granularity);
36
37 // Extract the relevant portions of the start and end timestamps
38 // based on the granularity
39 String startPrefix = start.substring(0, granularityLength);
40 String endPrefix = end.substring(0, granularityLength);
41
42 // Loop over all log entries to find the logs within the time range
43 for (LogEntry logEntry : logEntries) {
44 // Extract the relevant portion of the log's timestamp
45 String logTimestampPrefix = logEntry.getTimestamp().substring(0, granularityLength);
46
47 // Check if the log's timestamp is within the range
48 if (startPrefix.compareTo(logTimestampPrefix) <= 0 && logTimestampPrefix.compareTo(endPrefix) <= 0) {
49 result.add(logEntry.getId());
50 }
51 }
52 return result;
53 }
54}
55
56// Class representing an individual log entry
57class LogEntry {
58 private int id; // The ID of the log entry
59 private String timestamp; // The timestamp of the log entry
60
61 // Constructor for log entry
62 public LogEntry(int id, String timestamp) {
63 this.id = id;
64 this.timestamp = timestamp;
65 }
66
67 // Getter for ID
68 public int getId() {
69 return id;
70 }
71
72 // Getter for Timestamp
73 public String getTimestamp() {
74 return timestamp;
75 }
76}
77
78/**
79 * The LogSystem class can be used as follows:
80 * LogSystem logSystem = new LogSystem();
81 * logSystem.put(id, timestamp); // to store a log entry
82 * List<Integer> results = logSystem.retrieve(start, end, granularity); // to retrieve log entries
83 */
84
1#include <vector>
2#include <string>
3#include <unordered_map>
4
5using std::vector;
6using std::string;
7using std::unordered_map;
8using std::pair;
9
10class LogSystem {
11public:
12 LogSystem() {
13 granularityMap_["Year"] = 4; // Year granularity ends at the 4th character index (yyyy)
14 granularityMap_["Month"] = 7; // Month granularity ends at the 7th character index (yyyy-MM)
15 granularityMap_["Day"] = 10; // Day granularity ends at the 10th character index (yyyy-MM-dd)
16 granularityMap_["Hour"] = 13; // Hour granularity ends at the 13th character index (yyyy-MM-dd:HH)
17 granularityMap_["Minute"] = 16; // Minute granularity ends at the 16th character index (yyyy-MM-dd:HH:mm)
18 granularityMap_["Second"] = 19; // Second granularity ends at the 19th character index (yyyy-MM-dd:HH:mm:ss)
19 }
20
21 // Stores a log entry with a unique ID and timestamp.
22 void put(int id, string timestamp) {
23 logs_.emplace_back(id, timestamp);
24 }
25
26 // Retrieves IDs of log entries that have timestamps between the range [start, end],
27 // considering the specified granularity.
28 vector<int> retrieve(string start, string end, string granularity) {
29 vector<int> result; // To store the matching log entry IDs.
30 int index = granularityMap_[granularity]; // Index determines the granularity level.
31
32 // Substrings of start and end based on the granularity to compare the timestamps.
33 auto startSubstr = start.substr(0, index);
34 auto endSubstr = end.substr(0, index);
35
36 // Iterate through all stored logs to find matching entries.
37 for (const auto& logEntry : logs_) {
38 // Substring the timestamp of the current log to match granularity.
39 auto timestampSubstr = logEntry.second.substr(0, index);
40
41 // If the log's timestamp is within the range, add its ID to the result.
42 if (startSubstr <= timestampSubstr && timestampSubstr <= endSubstr) {
43 result.emplace_back(logEntry.first);
44 }
45 }
46 return result;
47 }
48
49private:
50 vector<pair<int, string>> logs_; // Vector storing log entries as <ID, timestamp> pairs.
51 unordered_map<string, int> granularityMap_; // Maps granularity strings to substring index limits.
52};
53
1// TypeScript code for a log system using global variables and functions
2
3// Define available granularities and corresponding character index limits in a timestamp
4const granularityMap: { [key: string]: number } = {
5 "Year": 4, // Year granularity ends at the 4th character index (yyyy)
6 "Month": 7, // Month granularity ends at the 7th character index (yyyy-MM)
7 "Day": 10, // Day granularity ends at the 10th character index (yyyy-MM-dd)
8 "Hour": 13, // Hour granularity ends at the 13th character index (yyyy-MM-dd:HH)
9 "Minute": 16, // Minute granularity ends at the 16th character index (yyyy-MM-dd:HH:mm)
10 "Second": 19 // Second granularity ends at the 19th character index (yyyy-MM-dd:HH:mm:ss)
11};
12
13// Initialize an array to store log entries as {id, timestamp} objects
14let logs: { id: number; timestamp: string }[] = [];
15
16// Function to store a log entry with a unique ID and timestamp
17function put(id: number, timestamp: string): void {
18 logs.push({ id, timestamp });
19}
20
21// Function to retrieve IDs of log entries that have timestamps between the range [start, end],
22// considering the specified granularity
23function retrieve(start: string, end: string, granularity: string): number[] {
24 const result: number[] = []; // Array to store the matching log entry IDs
25 const index: number = granularityMap[granularity]; // Index determines the granularity level
26
27 // Substrings of start and end based on the granularity to compare timestamps
28 const startSubstr: string = start.substring(0, index);
29 const endSubstr: string = end.substring(0, index);
30
31 // Iterate through all stored logs to find matching entries
32 for (const logEntry of logs) {
33 // Substring the timestamp of the current log to match granularity
34 const timestampSubstr: string = logEntry.timestamp.substring(0, index);
35
36 // If the log's timestamp is within the range, add its ID to the result
37 if (startSubstr <= timestampSubstr && timestampSubstr <= endSubstr) {
38 result.push(logEntry.id);
39 }
40 }
41 return result;
42}
43
Time and Space Complexity
Time Complexity
put method:
The put
operation has a time complexity of O(1)
since it only involves appending a tuple (ID and timestamp) to the end of the self.logs
list which is a constant time operation.
retrieve method:
The retrieve
operation involves iterating over each log entry in self.logs
and comparing the substrings of their timestamps. The time complexity is O(n * s)
where n
is the number of log entries and s
is the length of the timestamp substring being compared. The complexity of the comparison operation is assumed to be O(1)
since the length of the substring depends on the granularity and doesn't change with the size of self.logs
.
Space Complexity
Overall:
The space complexity of the LogSystem class is O(n)
, where n
is the number of log entries stored in self.logs
. Each log entry requires a fixed amount of space for the integer ID and a fixed-length string for the timestamp, resulting in space directly proportional to the number of entries.
put method:
For the put
method, it only appends the log data without needing any extra space besides the self.logs
, so the space complexity incurred by this method is O(1)
in addition to the overall O(n)
space needed for storing the logs themselves.
retrieve method:
The retrieve
method creates a new list of IDs that match the criteria, the space complexity of which is O(k)
where k
is the number of matching log entries returned. Since k
can be at most n
in the worst case, the worst-case space complexity for retrieve
can also be O(n)
.
Learn more about how to find time and space complexity quickly using problem constraints.
What's the output of running the following function using input [30, 20, 10, 100, 33, 12]
?
1def fun(arr: List[int]) -> List[int]:
2 import heapq
3 heapq.heapify(arr)
4 res = []
5 for i in range(3):
6 res.append(heapq.heappop(arr))
7 return res
8
1public static int[] fun(int[] arr) {
2 int[] res = new int[3];
3 PriorityQueue<Integer> heap = new PriorityQueue<>();
4 for (int i = 0; i < arr.length; i++) {
5 heap.add(arr[i]);
6 }
7 for (int i = 0; i < 3; i++) {
8 res[i] = heap.poll();
9 }
10 return res;
11}
12
1class HeapItem {
2 constructor(item, priority = item) {
3 this.item = item;
4 this.priority = priority;
5 }
6}
7
8class MinHeap {
9 constructor() {
10 this.heap = [];
11 }
12
13 push(node) {
14 // insert the new node at the end of the heap array
15 this.heap.push(node);
16 // find the correct position for the new node
17 this.bubble_up();
18 }
19
20 bubble_up() {
21 let index = this.heap.length - 1;
22
23 while (index > 0) {
24 const element = this.heap[index];
25 const parentIndex = Math.floor((index - 1) / 2);
26 const parent = this.heap[parentIndex];
27
28 if (parent.priority <= element.priority) break;
29 // if the parent is bigger than the child then swap the parent and child
30 this.heap[index] = parent;
31 this.heap[parentIndex] = element;
32 index = parentIndex;
33 }
34 }
35
36 pop() {
37 const min = this.heap[0];
38 this.heap[0] = this.heap[this.size() - 1];
39 this.heap.pop();
40 this.bubble_down();
41 return min;
42 }
43
44 bubble_down() {
45 let index = 0;
46 let min = index;
47 const n = this.heap.length;
48
49 while (index < n) {
50 const left = 2 * index + 1;
51 const right = left + 1;
52
53 if (left < n && this.heap[left].priority < this.heap[min].priority) {
54 min = left;
55 }
56 if (right < n && this.heap[right].priority < this.heap[min].priority) {
57 min = right;
58 }
59 if (min === index) break;
60 [this.heap[min], this.heap[index]] = [this.heap[index], this.heap[min]];
61 index = min;
62 }
63 }
64
65 peek() {
66 return this.heap[0];
67 }
68
69 size() {
70 return this.heap.length;
71 }
72}
73
74function fun(arr) {
75 const heap = new MinHeap();
76 for (const x of arr) {
77 heap.push(new HeapItem(x));
78 }
79 const res = [];
80 for (let i = 0; i < 3; i++) {
81 res.push(heap.pop().item);
82 }
83 return res;
84}
85
Recommended Readings
LeetCode Patterns Your Personal Dijkstra's Algorithm to Landing Your Dream Job The goal of AlgoMonster is to help you get a job in the shortest amount of time possible in a data driven way We compiled datasets of tech interview problems and broke them down by patterns This way we
Recursion Recursion is one of the most important concepts in computer science Simply speaking recursion is the process of a function calling itself Using a real life analogy imagine a scenario where you invite your friends to lunch https algomonster s3 us east 2 amazonaws com recursion jpg You first
Runtime Overview When learning about algorithms and data structures you'll frequently encounter the term time complexity This concept is fundamental in computer science and offers insights into how long an algorithm takes to complete given a certain input size What is Time Complexity Time complexity represents the amount of time
Want a Structured Path to Master System Design Too? Don’t Miss This!