322 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
hinto-janai	929d19c450	rpc: custom epee for misc/bin types (#229) ... * fixed-bytes: add `serde`, document feature flags * fixed-bytes: add derives * rpc: add `as _` syntax to macro * rpc: use `ByteArrayVec` and `ContainerAsBlob` for binary types * fixed-bytes: re-add derives * rpc-types: dedup default value within macro * readme: fixed bytes section * types: custom epee - `BlockCompleteEntry` * types: custom epee - `KeyImageSpentStatus` * types: custom epee - `PoolInfoExtent` * types: add `Status::Other(String)` variant * types: custom epee - `TxEntry`, add `read_epee_field` macro * bin: custom epee - `GetBlocks` * types: add `serde.rs` * misc: make `TxEntry` an `enum`, impl serde * misc: `unimplemented!()` for `TxEntry`'s epee * types: add `BlockCompleteEntry` * rpc: replace `BlockCompleteEntry` with `cuprate-types` * types: document `BlockCompleteEntry` * bin: fix `number_of_fields` for `GetBlocksResponse` * misc: add `Distribution` * distribution: add todo * misc fixes * readme: add `(De)serialization invariants` * distribution: compress variants * types: add `block_complete_entry.rs` * net: fix imports * p2p: fix imports * turn off default-features * p2p: fix imports * misc fixes * Update net/wire/Cargo.toml Co-authored-by: Boog900 <boog900@tutanota.com> * distribution: module doc * wire: re-export types * bin: use enum for `GetBlocksResponse` * misc: use lowercase for stringify * remove duplicated fields for custom epee * types: remove `should_write()` for custom epee * bin: split `GetBlocksResponse` variant fields into structs * misc: split `Distribution` variant fields into structs * small fixes * put all fields in `read_epee_field!` * distribution: (de)compress during epee/serde (de)serialization * distribution: leave (de)compression functions as `todo!()` --------- Co-authored-by: Boog900 <boog900@tutanota.com>	2024-07-25 16:46:41 +01:00
hinto-janai	aa718e224f	test-utils: add crate::rpc::data module (#231) ... * test-utils: add `crate::rpc::types` module * test-utils: conditional json doc-tests * json: add test data, fix macro doc tests * json: add all data * other: add all data * bin: add skeleton * docs * move type to correct file * rpc: `client/{client,constants}.rs` -> `client.rs` * lib.rs: remove `clippy::module_inception`	2024-07-19 00:50:27 +01:00
hinto-janai	0a88ea13fc	books: architecture skeleton (#224) ... * upstream https://github.com/hinto-janai/cuprate-architecture * tab -> 4 spaces	2024-07-18 21:35:52 +01:00
Boog900	88551c800c	Books: document p2p protocol (#216) ... * add admin message definitions * add block complete entry * add protocol messages * add most flows * add final flows * fix typos * move link to epee * review fixes	2024-07-18 21:34:56 +01:00
hinto-janai	6820da9848	types: add BlockCompleteEntry (#230) ... * types: add `block_complete_entry.rs` * net: fix imports * p2p: fix imports * turn off default-features * p2p: fix imports * Update net/wire/Cargo.toml Co-authored-by: Boog900 <boog900@tutanota.com> * wire: re-export types --------- Co-authored-by: Boog900 <boog900@tutanota.com>	2024-07-16 22:47:50 +01:00
hinto-janai	0910c0a231	rpc: use ByteArrayVec and ContainerAsBlob (#227) ... * fixed-bytes: add `serde`, document feature flags * fixed-bytes: add derives * rpc: add `as _` syntax to macro * rpc: use `ByteArrayVec` and `ContainerAsBlob` for binary types * fixed-bytes: re-add derives * rpc-types: dedup default value within macro * readme: fixed bytes section	2024-07-13 01:26:11 +01:00
hinto-janai	0a390a362a	storage: doc fixes (#228) ... * database: doc fixes * blockchain: doc fixes * database: fix doc test * database: readme fixes * blockchain: ops fix * blockchain: readme fix	2024-07-12 22:15:02 +01:00
hinto-janai	fbae3df203	storage: move table generator macro blockchain -> database (#222) ... * move table generator macro `blockchain` -> `database` * blockchain: fix imports * docs * fix import ordering	2024-07-11 14:20:56 +01:00
hinto-janai	824651c8cf	fixed-bytes: add serde, document feature flags (#226) ... * fixed-bytes: add `serde`, document feature flags * manual impl `serde::Deserialize` * add serde tests	2024-07-11 02:00:47 +01:00
hinto-janai	5aeb8af4b4	rpc: implement other JSON types (#221) ... * `serde/epee` feature flags * modify type generator macros * add `defaults.rs` * add `free.rs` * add `misc` module * modify `base.rs`, `contants.rs` * remove `binary_string.rs`, `status.rs` * fix macro usage * impl `other.rs` * base: re-add `AccessRequestBase` * fix default functions * tx_entry: fix link * other: fix default functions * Update rpc/types/src/other.rs Co-authored-by: Boog900 <boog900@tutanota.com> * Update rpc/types/src/other.rs Co-authored-by: Boog900 <boog900@tutanota.com> --------- Co-authored-by: Boog900 <boog900@tutanota.com>	2024-07-10 22:31:56 +01:00
hinto-janai	612938eae6	database: workaround redb page freeing issue (#225) ... * redb: `SyncMode::Fast` => `redb::Durability::Eventual` * redb: fix clippy * database: document `SyncMode`	2024-07-10 22:11:09 +01:00
hinto-janai	303c165df7	rpc: implement .bin types (#220) ... * `serde/epee` feature flags * modify type generator macros * add `defaults.rs` * add `free.rs` * add `misc` module * modify `base.rs`, `contants.rs` * remove `binary_string.rs`, `status.rs` * fix macro usage * impl `bin.rs` * base: re-add `AccessRequestBase` * fix default functions * tx_entry: fix link * bin: fix default functions	2024-07-10 21:19:19 +01:00
hinto-janai	ecbb5ad3dc	rpc: implement /json_rpc types (#219) ... * `serde/epee` feature flags * modify type generator macros * add `defaults.rs` * add `free.rs` * add `misc` module * modify `base.rs`, `contants.rs` * remove `binary_string.rs`, `status.rs` * fix macro usage * impl `json.rs` * base: re-add `AccessRequestBase` * fix default functions * tx_entry: fix link * json: fix default functions * json: fix `on_get_block_hash`, `submit_block` * json: `status` -> `block_id` * json: fix `SubmitBlockRequest` * json: fix `OnGetBlockHashResponse` The serialized `result` field will come from our `json-rpc` crate, so the inner type should be a `transparent` string. * json: `Response` -> `ResponseBase` for `SubmitBlock` * Update rpc/types/src/json.rs Co-authored-by: Boog900 <boog900@tutanota.com> * json: fix `SubmitBlockRequest` doc test --------- Co-authored-by: Boog900 <boog900@tutanota.com>	2024-07-10 21:12:40 +01:00
hinto-janai	5c3258a6e3	workspace: add lints (#133) ... add lints to workspace	2024-07-10 01:32:23 +01:00
dependabot[bot]	0d7b86abe3	build(deps): bump zerovec from 0.10.2 to 0.10.4 (#217) ... Bumps [zerovec](https://github.com/unicode-org/icu4x) from 0.10.2 to 0.10.4. - [Release notes](https://github.com/unicode-org/icu4x/releases) - [Changelog](https://github.com/unicode-org/icu4x/blob/main/CHANGELOG.md) - [Commits](https://github.com/unicode-org/icu4x/commits/ind/zerovec@0.10.4) --- updated-dependencies: - dependency-name: zerovec dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2024-07-09 23:03:13 +01:00
dependabot[bot]	03815efe29	build(deps): bump zerovec-derive from 0.10.2 to 0.10.3 (#223) ... Bumps [zerovec-derive](https://github.com/unicode-org/icu4x) from 0.10.2 to 0.10.3. - [Release notes](https://github.com/unicode-org/icu4x/releases) - [Changelog](https://github.com/unicode-org/icu4x/blob/main/CHANGELOG.md) - [Commits](https://github.com/unicode-org/icu4x/commits/ind/zerovec-derive@0.10.3) --- updated-dependencies: - dependency-name: zerovec-derive dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2024-07-09 23:01:31 +01:00
hinto-janai	136abf7edd	rpc: feature flags, macro changes, misc setup (#218) ... * `serde/epee` feature flags * modify type generator macros * add `defaults.rs` * add `free.rs` * add `misc` module * modify `base.rs`, `contants.rs` * remove `binary_string.rs`, `status.rs` * fix macro usage * base: re-add `AccessRequestBase` * fix default functions * tx_entry: fix link	2024-07-09 22:58:02 +01:00
Boog900	a82c08cc80	Storage: fix lifetimes (#215) ... * fix db lifetimes * fix redb * fix blockchain with redb * add docs	2024-07-06 13:21:46 +01:00
Boog900	d5c8eba1d8	P2P: API Improvements (#168) ... * start handshaker builder * finish builder * remove borsh requirement * fix poll_ready :/ * add more docs to builder * more docs * fix clippy * merge fixes * fix doc test * fix imports * cargo fmt * split `PeerRequest` and `PeerResponse` enums up. This splits them both into a protocol and admin enum * add request handler file * integrate request handler into connection * fix docs * doc updates * add more docs * fix docs * misc changes * review fixes * fix merge * add dummy file * fix docs * Update p2p/dandelion-tower/src/router.rs * fix docs	2024-07-04 21:05:22 +01:00
hinto-janai	71131a4836	ci: fix doc.yml (#213) ... * types: remove borsh/serde * blockchain: re-add optional serde * doc.yml: remove `-D warnings`	2024-07-04 15:52:51 +01:00
hinto-janai	a8b58fa4db	ci: add doc.yml (#203) ... * ci: add `doc.yml` * update `{CONTRIBUTING,README}.md` * readme: formatting	2024-07-03 22:38:47 +01:00
Boog900	7c8466f4ba	Storage: add blockchain history requests (#206) ... * Add database requests for chain history * misc fixes * review comments * fix clippy * add link and fix typo * Apply suggestions from code review Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * add comment --------- Co-authored-by: hinto-janai <hinto.janai@protonmail.com>	2024-07-02 23:08:19 +01:00
hinto-janai	6ce177aeca	storage: add key sorting (#198) ... * database: modify `trait Key`, don't blanket impl * heed: create `KeyHeed<T>` wrapper type * fix backend/tests * blockchain: `impl Key PreRctOutputId` * database: `StorableStr`, docs, tests * key: docs, cleanup * fixes * heed: simplify types * storable: remove doc * heed: use `INTEGER_KEY` instead of custom compare fn * add docs, tests * database: document `create_db` invariant * key: `Lexicographic` -> `Default` * redb: fix `clear_db` behavior * fix docs	2024-07-01 20:24:48 +01:00
Boog900	fb1f071faf	P2P: fix block downloader test (#205) ... make sure timeout is non-zero	2024-07-01 20:23:59 +01:00
Boog900	f91be58a7f	P2P: Fix freeze in D++ (#204) ... * Fix d++ router freeze * update docs * fix imports * fix clippy * Update p2p/dandelion-tower/src/lib.rs Co-authored-by: hinto-janai <hinto.janai@protonmail.com> --------- Co-authored-by: hinto-janai <hinto.janai@protonmail.com>	2024-07-01 20:23:40 +01:00
dependabot[bot]	7e9891de5b	build(deps): bump curve25519-dalek from 4.1.2 to 4.1.3 (#197) ... Bumps [curve25519-dalek](https://github.com/dalek-cryptography/curve25519-dalek) from 4.1.2 to 4.1.3. - [Release notes](https://github.com/dalek-cryptography/curve25519-dalek/releases) - [Commits](https://github.com/dalek-cryptography/curve25519-dalek/compare/curve25519-4.1.2...curve25519-4.1.3) --- updated-dependencies: - dependency-name: curve25519-dalek dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2024-06-26 22:59:11 +01:00
hinto-janai	a438279aa8	storage: split cuprate-blockchain <-> cuprate-database (#160) ... * storage: port some code `cuprate-blockchain` -> `database` * database: remove `Tables` references * database: remove old `cuprate-blockchain` type references * find/replace `cuprate_blockchain` -> `database`, add `create_db()` * database: fix redb * database: use readme for docs, link in `lib.rs` * database: fix `open_db_ro`, `open_db_rw`, `create_db` behavior * database: add open table tests * database: fix tests, remove blockchain specific references * database: remove `ReaderThreads`, make `db_directory` mandatory * initial `cuprate-blockchain` split * fix doc links * rename, fix database config * blockchain: create `crate::open()`, `OpenTables::create_tables()` * more compat fixes * fix imports * fix conflicts * align cargo.toml * docs * fixes * add `unused_crate_dependencies` lint, fix * blockchain: add open table tests	2024-06-26 22:51:06 +01:00
hinto-janai	e405786a73	rpc: start cuprate-rpc-types (#147) ... * rpc: add `monero-rpc-types` * lib.rs: add lints * add base files, deps * fix macro generation, doc test * add `strum`, add `misc` module * document struct generation macro * add `GetHeight` * lib.rs: create re-export macro * macro changes, add few more types * docs * `monero-rpc-types` -> `cuprate-rpc-types` * fix modules * specify commit in macro, add () type aliases * macro docs, fixes * add `Status::Other(String)` * add TODO for `strum` * Update rpc/types/Cargo.toml Co-authored-by: Boog900 <boog900@tutanota.com> * add `BinaryString` * add `ResponseBase` * add `CORE_RPC_*` constants * fix status; use `CORE_RPC_*` constants * cargo.toml: add `epee_encoding` * rpc: add epee_encoding impl for `Status` * macro: add epee_encoding for every type * remove `strum` * add response bases * add `CORE_RPC_STATUS_UNKNOWN` * add response/request bases for epee * create `base` module * use different type for macro example * move base / root types around * docs, status serde test * status: use `Status::Unknown` for `epee_default_value` * json: add missing fields to `GetBlockTemplateRequest` not sure I missed these cc73fe7116/src/rpc/core_rpc_server_commands_defs.h (L947-L950) --------- Co-authored-by: Boog900 <boog900@tutanota.com>	2024-06-26 22:24:05 +01:00
Boog900	5c08d1a0e2	Consensus: fix Rx VM initialization (#190) ... * fix Rx VM initialization * fix imports * Apply suggestions from code review Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * use checked_sub --------- Co-authored-by: hinto-janai <hinto.janai@protonmail.com>	2024-06-25 01:55:04 +01:00
hinto-janai	4b93dbec4c	workspace: enforce crate/directory naming scheme (#164) ... * rename all directories and crates * fix all `use` * fix doc link * `dandelion/` -> `dandelion-tower/` * fix epee-encoding test * fix `json-rpc` * fix pruning * crate import fixes * fix leftover merge conflicts * fix `epee-encoding`	2024-06-24 02:30:47 +01:00
Boog900	519d871ccb	books: move in protocol book (#169) ... * add protocol bool * update url * fix typos * Cuprate's protocol book -> Monero * Apply suggestions from code review Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * fix typo * POW -> PoW * revert weird line changes --------- Co-authored-by: hinto-janai <hinto.janai@protonmail.com>	2024-06-24 01:23:39 +01:00
hinto-janai	fe1d5faac9	contributing: expand issue/PR sections, re-format (#186) ... * contributing.md: expand tracking issue/pr section * add tracking issue section * re-format sections * typos * fix links * add `.github/pull_request_template.md` * add `Pull request title and description` section * wording	2024-06-22 01:33:29 +01:00
Boog900	10aac8cbb2	P2P: Block downloader (#132) ... * impl async buffer * clippy * p2p changes * clippy * a few more docs * init cuprate-p2p * remove some unrelated code and add some docs * start documenting client_pool.rs * add more docs * typo * fix docs * use JoinSet in connection maintainer * small changes * add peer sync state svc * add broadcast svc * add more docs * add some tests * add a test * fix merge * add another test * unify PeerDisconnectFut and add more docs * start network init * add an inbound connection server * remove crate doc for now * fix address book docs * fix leak in client pool * correct comment * fix merge + add some docs * review comments * init block downloader * fix doc * initial chain search * add chain_tracker * move block downloader to struct * spawn task whe getting blocks * check for free peers and handle batch response * add test bin * working block downloader * dynamic batch sizes * dandelion_tower -> dandelion-tower * fix async-buffer builds * check if incoming peers are banned * add interface methods * update docs * use a JoinSet for background network tasks * dynamic batch size changes * Keep a longer of queue of blocks to get * more checks on incoming data * fix merge * fix imports * add more docs * add some limits on messages * keep peers that dont have the current need data * fix clippy * fix .lock * fix stopping the block downloader * clean up API and add more docs * tracing + bug fixes * fix panic * doc changes * remove test_init * remove spammy log * fix previous merge * add a test * fix test * remove test unwrap * order imports correctly * clean up test * add a timeout * fix tests * review fixes * make `BlockDownloader` pub * make `initial_chain_search` pub * make `block_downloader` private * Apply suggestions from code review Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * split some sections into separate modules * split chain requests * sort imports * check previous ID is correct * fix typos * Apply suggestions from code review Co-authored-by: hinto-janai <hinto.janai@protonmail.com> --------- Co-authored-by: hinto-janai <hinto.janai@protonmail.com>	2024-06-22 01:29:40 +01:00
hinto-janai	ff1172f2ab	epee: make {read,write}_varint public, create write_{bytes,container} (#185) ... * make `{read,write}_varint` public, create `write_{container,bytes}` * add doc tests to varint functions * `write_container` -> `write_iterator` * add `write_{iterator,bytes}` doc test * fix `write_iterator()` doc	2024-06-22 01:25:21 +01:00
hinto-janai	f6c4e4e9a8	repo: add Tracking Issue issue template (#182) ... * add `tracking_issue.md` * fix `{bug,proposal}.md` * format `tracking_issue.md`	2024-06-20 23:27:09 +01:00
hinto-janai	bef2a2cbd4	epee: unseal trait EpeeValue (#184) ... * unseal `trait EpeeValue` * fix `container_as_blob.rs` * clippy * epee-encoding: remove `sealed`	2024-06-20 23:20:13 +01:00
Boog900	b76042a4e4	Cargo update (#171) ... cargo update	2024-06-18 22:43:35 +01:00
jomuel	c837f2f48e	Fast sync part 2 (#156) ... * boilerplate * Cargo.lock * Stub of block validation * Block validation (diff by @dllud) * Cargo.lock * Complete implementation of block validation request * Apply suggestions from code review Co-authored-by: Boog900 <boog900@tutanota.com> * More suggestions * Update consensus/fast-sync/src/fast_sync.rs * Update consensus/fast-sync/src/fast_sync.rs --------- Co-authored-by: Boog900 <boog900@tutanota.com>	2024-06-14 23:00:18 +01:00
hinto-janai	f07d08942f	contributing: add & format sections (#150) ... * update contributing * formatting * add documentation section and user-book * add crate names section * formatting * add `A-help-wanted` label * add monerod binary note	2024-06-14 22:35:15 +01:00
hinto-janai	1bc05366b0	docs: update README.md & SECURITY.md (#143) ... * reduce cuprate banner size * update readme * update `SECURITY.md * formatting * readme: add todo * update license section * add user book, current about * formatting * formatting	2024-06-14 18:33:43 +01:00
hinto-janai	86c01ab95a	contributing: add crate naming rules (#144) ... * contributing.md: add crate naming rules * Update CONTRIBUTING.md Co-authored-by: SyntheticBird <118022351+SyntheticBird45@users.noreply.github.com> * edit contributing for https://github.com/Cuprate/cuprate/pull/144#discussion_r1638344193 * `monero-wire` -> `wire/`, `cuprate-monero-wire` -> `cuprate-wire` --------- Co-authored-by: SyntheticBird <118022351+SyntheticBird45@users.noreply.github.com>	2024-06-14 18:30:53 +01:00
Boog900	acd5380256	Fix clippy & Cargo update (#161) ... * fix clippy * run cargo update * fix cargo deny * remove duplicate `#[test]`	2024-06-13 19:08:34 +01:00
hinto-janai	25b5b63349	ci: update actions/cache -> v4 (#158)	2024-06-13 16:37:26 +01:00
hinto-janai	a3e34c3ba8	rpc: implement json-rpc crate (#148) ... * rpc: add `json-rpc` from https://github.com/Cuprate/cuprate/pull/43 Maintains all the changes made in that branch * workspace: add `rpc/json-rpc` * json-rpc: fix cargo.toml * add todo * satisfy clippy * `method/params` -> `body` switch, adjust input types * add test helpers, test tagged enums and flatten structs * fix id type `None` <-> `Some(Id::Null)` difference * lib.rs: add docs * impl `Version` * impl `Id` * impl `Request` * impl `Response` * impl `ErrorCode` * impl `ErrorObject` * fixes * add monero jsonrpc tests * response: add id test * add display docs to `ErrorObject` * remove `#[inline]` * add id null test * cleanup * code: clarify Monero's error code usage in docs * id: fix macro indentation * readme: fix `Response` -> `Request` * request: add `lowercase` test * tests: formatting, more string tests * readme: add `Serialization changes` * code: ugly `match` -> `if` * response: manual deserialization impl - lowercase keys only - enforce either `result/error` but not both * remove unneeded clone bounds * readme: add implementation comparison tests * request/response: more tests * readme: formatting, assert error messages are expected * request: add unknown field test * request/response: add unknown field and unicode test	2024-06-12 02:12:31 +01:00
jomuel	663c852b13	Fast sync (WIP) (#155) ... * Fast sync (work in progress) * Cargo.lock * Add missing hashes file * clippy warnings * Stub of database tool to create the fast sync hashes * Command line arg for target height, error handling * Cargo.lock * fmt and unused imports * fmt * Add license information to consensus/fast-sync/Cargo.toml Co-authored-by: Boog900 <boog900@tutanota.com> * Order imports in consensus/fast-sync/src/create.rs Co-authored-by: Boog900 <boog900@tutanota.com> * beautify hex generation function & fmt * Reorder imports consensus/fast-sync/src/fast_sync.rs	2024-06-09 14:24:44 +01:00
hinto-janai	e0736d1807	books: add user-book template (#154) ... * add user-book * add `A-book-user` to labeler	2024-06-07 22:04:27 +01:00
Boog900	0e5555d4d4	Consensus: block batch prepper (#151) ... * add block batch prepper * Apply suggestions from code review Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * review comments * review comments * fix doc --------- Co-authored-by: hinto-janai <hinto.janai@protonmail.com>	2024-06-07 21:23:48 +01:00
Boog900	07f61bdb9c	Consensus: fix panic in batch verifier (#152) ... * fix panic in batch verifier * docs * review comments * Update consensus/rules/src/batch_verifier.rs Co-authored-by: hinto-janai <hinto.janai@protonmail.com> --------- Co-authored-by: hinto-janai <hinto.janai@protonmail.com>	2024-06-07 13:34:53 +01:00
hinto-janai	6df67bb9d3	rpc: add initial crates (#146) ... * add `rpc/` crates * rpc: fix `monero-rpc-server` -> `monero-rpc-types` * rpc: add skeleton `rpc/json-rpc` * remove `cuprate-rpc-server`, add `json-rpc`	2024-06-05 15:35:08 +01:00
Boog900	0622237d19	Consensus: use cuprate-types types (#145) ... * move consensus database to /types * fix `storage` builds * unify `VerifiedBlockInformation` * fix docs * change `Database` trait wording * order imports * service -> blockchain * Apply suggestions from code review Co-authored-by: hinto-janai <hinto.janai@protonmail.com> * fix typo * fix key_images_spent * add back todo * fix tests * service -> blockchain 2 * update docs * update docs 2 --------- Co-authored-by: hinto-janai <hinto.janai@protonmail.com>	2024-06-04 18:19:35 +01:00