1579 Commits

Author	SHA1	Message	Date
Peter Surda	6062277d60	Rename configparser.py to bmconfigparser.py ... - it was causing problems with py2app because the source of python's own CongigParser is also configparser.py	2017-02-22 09:34:54 +01:00
Peter Surda	266d8eba1f	SafeHTMLParser unicode / subprocess ... - don't do subprocess in SafeHTMLParser, it doesn't work in frozen mode and an attempt to fix it would take too much refactoring and I'm not even sure it would work - instead, make it handle broken unicode correctly - I think the previous reports of freezes were caused by trying to interpret data as unicode, causing a crash - it does about 1MB/s on my machine, so a timeout is not a big problem	2017-02-22 09:05:05 +01:00
Justin Ramos	fd95f8f519	allowing for max outbound connection configuration ... Signed-off-by: Justin Ramos <justin.ramos@gmail.com>	2017-02-21 16:28:54 -06:00
Peter Surda	c8429365e3	Typo ... - typo in last commit	2017-02-21 10:25:59 +01:00
Peter Surda	fef6126a74	Error handling improvement in sendDataThread ... - don't uncecessarily report EPIPE as a big error, just close the connection	2017-02-21 09:58:28 +01:00
Peter Surda	ea9f10a8bb	Simplify and fix list of addresses to send ... - it didn't always send the maximum possible amount - it probably was slow	2017-02-20 22:32:49 +01:00
Peter Surda	579ba49f38	Deamon mode without PyQt4 ... - daemon mode shouldn't require PyQt4	2017-02-20 20:53:50 +01:00
Peter Surda	9c4366ffa6	Don't report direct network errors as proxy errors ... - last commit reported network errors that happened when proxy was off as network errors	2017-02-20 12:34:55 +01:00
Peter Surda	ea448c4496	SOCKS error handler winsock compatibility ... - now it can detect WSA errors as well, allowing more accurate error feedback	2017-02-20 12:15:51 +01:00
Peter Surda	46a2c361de	Building and msgpack fixes ... - Makefile typo - pyinstaller rewritten and fixed including and initialisation of messagetypes - msgpack decoding new message display fix	2017-02-19 19:48:45 +01:00
Peter Surda	67c8966a21	Windows compatibility fixes ... - spec file for pyinstaller detects architecture (32 or 64bit) - spec file uses os.path.join - spec file creates and adds the list of messagetypes - added MinGW/MSyS support in Makefile - separate Makefile.msvc for MCVC - bitmsghash.cpp minor adjustments to build also on MSVC/MinGW - if frozen mode, messagetypes loads the list of files from a text file generated during archive building rather than from a directory	2017-02-19 14:48:53 +01:00
Peter Surda	a95f4aa255	LibreSSL compatibility ... - code distinguishes between OpenSSL 1.1.x and LibreSSL and works with both	2017-02-18 17:22:17 +01:00
Peter Surda	75f715bfe4	BSD compatibility ... - separate Makefile for BSD make - auto-compile will detect BSD and pass the correct parameters to make - C PoW builds on OpenBSD and detects number of cores	2017-02-18 17:20:09 +01:00
Peter Surda	6c907e2046	Windows socket typo	2017-02-17 21:14:39 +01:00
Peter Surda	f499a3b1d8	Typo	2017-02-14 13:57:20 +01:00
Peter Surda	f94b2d2d4b	Windows compatibility fixes ... - there is no errno.WSAEAGAIN, only errno.WSAEWOULDBLOCK	2017-02-14 01:38:58 +01:00
Peter Surda	a4b1a781ce	Minor UI fixes ... - "new" folder consistently appears in chans and "All accounts" - "Sent" message list sorting fix - When editing a label, keys.dat is saved and the lineEdit completer is updated - addressbook is updated when adding/deleting a new chan	2017-02-14 01:35:32 +01:00
Peter Surda	965f3548ac	Depends checking updates ... - checks for msgpack - can distinguish OS and make a recommendation with respect to the relevant package manager	2017-02-14 01:33:16 +01:00
Peter Surda	d8ae44f9ee	Obsolete imports, missing exception type	2017-02-09 21:04:07 +01:00
Peter Surda	c778b81427	knownNodes refactoring and shutdown fixes ... - saveKnownNodes replaced the repeated pickle.dump - with knownNodesLock instead of acquire/release - outgoingSynSender had an unnecessary loop during shutdown causing excessive CPU usage / GUI freezing	2017-02-09 11:53:33 +01:00
Peter Surda	e664746f04	More knownNodes init ... - also init children if they are missing	2017-02-08 20:52:18 +01:00
Peter Surda	b0539f5cb4	SSL handshake fewer errors ... - don't unnecessarily raise exceptions if SSL handshake fails	2017-02-08 20:49:14 +01:00
Peter Surda	35a712d11d	KnownNodes missing init ... - init knownnodes when connecting to a stream	2017-02-08 20:48:22 +01:00
Peter Surda	157881bc63	Cyclic import fix ... - networkDefaultProofOfWorkNonceTrialsPerByte and networkDefaultPayloadLengthExtraBytes cyclic import fix - PyBitmessage should launch now when there's no keys.dat	2017-02-08 20:37:42 +01:00
Peter Surda	2cc4435cfc	Imports, typos, syntax errors ... - remove obsolete imports - add missing imports - fix typos - fix syntax errors - thanks to landscape.io for report	2017-02-08 14:19:02 +01:00
Peter Surda	59f3a2fbe7	Reduce cyclic dependencies ... - rearranged code to reduce cyclic dependencies - doCleanShutdown is separated in shutdown.py - shared queues are separated in queues.py - some default values were moved to defaults.py - knownnodes partially moved to knownnodes.py	2017-02-08 13:41:56 +01:00
Peter Surda	7da36eccbd	Signal sender threads to close on shutdown ... - when shutdown is running, add a shutdown command to the queues of all sender threads	2017-02-07 20:47:28 +01:00
Peter Surda	a381f75b4b	Git head information in version ... - About dialog now shows the git head - git head check has been improved to point to the head rather than the previous commit	2017-02-07 20:46:30 +01:00
Peter Surda	2c72b337c1	Typos and formatting	2017-02-07 20:09:11 +01:00
Peter Surda	07722fb606	Node negotiation error handling ... - complete the version and SSL handshake first, and only then feed errors into the stream and close connection - this allows more accurate error handling on both sides - also the timeOffset error trigger is now more accurate, but requires more nodes to upgrade	2017-02-07 19:38:52 +01:00
Peter Surda	8515f9a9fc	Set SSL socket to blocking ... - otherwise the error handling gets too complicated	2017-02-07 16:42:02 +01:00
Peter Surda	6b65dfeeec	MarkAllUnread sqlite argument limit ... - shouldn't crash anymore if there are too many messages to mark read	2017-02-07 16:38:02 +01:00
Peter Surda	413419c858	Timeout handling and ping ... - timeouts after the connection is established will trigger a ping - previously they were handled as unrecoverable errors	2017-02-07 16:06:24 +01:00
Peter Surda	15c620dcc2	SSL socket blocking error handling	2017-02-07 13:00:24 +01:00
Peter Surda	ddc0ca5ede	Retry for certain non-blocking operations ... - sometimes on read, EWOULDBLOCK is returned. It should retry. A timeout is handled separately	2017-02-06 19:41:25 +01:00
Peter Surda	61770ba89a	Typo	2017-02-06 19:34:38 +01:00
Peter Surda	f6bdad18a3	Improved stream handling ... - version command sends list of all participating streams - biginv sends lists of hosts for all streams the peer wants (plus immediate children) - objects will spread to all peers that advertise the associated stream - please note these are just network subsystem adjustments, streams aren't actually usable yet	2017-02-06 17:47:05 +01:00
Peter Surda	79b566a907	Fix bitflags in version packet	2017-02-06 17:39:42 +01:00
Peter Surda	e434825bb2	Pending download counter fix ... - handles expired objects better - counts objects that failed download more accurately	2017-02-06 11:02:03 +01:00
Peter Surda	23fcf2cdec	SSL handshake python version compatibility ... - error handling should now work with < 2.7.9	2017-02-03 10:05:35 +01:00
Peter Surda	c979481564	Unhandled missing peer	2017-02-03 09:43:47 +01:00
Peter Surda	ba130e03e5	Network subsystem freezing fixes ... - queues were too short - some error handling was missing - remove nonblocking repeats in receive data thread - singleCleaner shouldn't wait unnecessarily	2017-02-02 15:52:32 +01:00
Peter Surda	4f70eaa01f	Fix curses mode	2017-02-02 15:48:56 +01:00
Peter Surda	f3849eeb48	Unused imports, problematic variable names	2017-01-19 20:04:45 +01:00
Peter Surda	01a9124b7d	Less verbose SSL handshake reporting ... - if SSL handshake fails, we don't need to stack trace because we know where it's happening. Only report the error string.	2017-01-19 19:52:54 +01:00
Peter Surda	5828021903	Fix false error about wrong stream ... - sendinv and sendaddress are sometimes being sent to connections that haven't been established yet, resulting in complaints about stream mismatch. The error should only be displayed once the connection has been established and the remote node provides its stream number	2017-01-19 19:50:40 +01:00
Peter Surda	5ae1327edc	Download/upload shutdown fixes ... - Missing renamed to PendingDownload - PendingDownload now only retries 3 times rather than 6 to dowload an object - Added PendingUpload, replacing invQueueSize - PendingUpload has both the "len" method (number of objects not uploaded) as well as "progress" method, which is a float from 0 (nothing done) to 1 (all uploaded) which considers not only objects but also how many nodes they are uploaded to - PendingUpload tracks when the object is successfully uploaded to the remote node instead of just adding an arbitrary time after they have been send the corresponding "inv" - Network status tab's "Objects to be synced" shows the sum of PendingUpload and PendingDownload sizes	2017-01-19 19:48:12 +01:00
Peter Surda	5708a38be0	Fix sending messages crashing	2017-01-17 01:07:39 +01:00
Peter Surda	9197c425d2	Object requesting fix	2017-01-17 00:32:05 +01:00
Peter Surda	9ed59dd825	Shutdown procedure cleanup	2017-01-16 23:38:18 +01:00
Peter Surda	ca8550a206	Don't send requests for 0 objects	2017-01-16 23:37:25 +01:00
Peter Surda	749bb628c0	Typo	2017-01-16 23:37:03 +01:00
Peter Surda	4f920fe641	Fix infinite loop	2017-01-16 23:17:56 +01:00
Peter Surda	d652dc864d	Downloading fixes ... - able to request more objects with one command - fixes to logic and error handling	2017-01-16 19:36:58 +01:00
Peter Surda	9f89df6d1c	Expire objects that we're unable to receive ... - sometimes a node would send an "inv" about an object but then not provide it when requested. This could be that it expired in the meantime or it was an attack or a bug. This patch will forget that the object exists if was requested too many times and not received.	2017-01-16 17:08:47 +01:00
Peter Surda	ca6bc9981c	Better tracking in downloading objects ... - remember what was requested from which node - remember if it was received - re-request object if we haven't received any new object for more than a minute	2017-01-16 15:17:23 +01:00
Peter Surda	8dfa0faca9	More objects to be downloaded fixes	2017-01-15 23:10:44 +01:00
Peter Surda	12205ee7ba	More fixes in objects to be downloaded	2017-01-15 23:07:11 +01:00
Peter Surda	bd1aead46e	More fixes for objects to be downloaded	2017-01-15 22:41:12 +01:00
Peter Surda	d04c0e78e4	Better handling of pending downloading objects	2017-01-15 22:36:12 +01:00
Peter Surda	b750e67bfb	Handle exception in iterator	2017-01-15 22:25:09 +01:00
Peter Surda	805f72e098	Make objects to be send stoppable if not empty	2017-01-15 22:21:19 +01:00
Peter Surda	94f0bdc731	Objects to be downloaded optimising ... - treat requested but never arrived objects as expired. This is how it worked before the refactoring. Without this, the list won't go to zero.	2017-01-15 22:01:10 +01:00
Peter Surda	79893fdc23	Performance tuning objects to be downloaded ... - rely on dict quasi-random order instead of an additional shuffle - request an object once per minute - stop check after count objects have been found	2017-01-15 20:47:33 +01:00
Peter Surda	dbe15d0b99	Objects to be downloaded fixes ... - tries to avoid calling senddata it it would block receiveDataThread, allowing fore more asynchronous operation - request objects in chunks of 100 (CPU performance optimisation)	2017-01-15 19:50:28 +01:00
Peter Surda	f079ff5b99	Refactor objects to be downloaded ... - moved logic into a Missing singleton - shouldn't try to download duplicates anymore, only requests a hash once every 5 minutes and not from the same host - removed obsoleted variables - the "Objects to be synced" in the Network tab should now be correct - removed some checks which aren't necessary anymore in my opinion - fix missing self in Throttle (thanks landscape.io)	2017-01-15 19:21:24 +01:00
Peter Surda	6d2a75bfc9	Transfer speed improvements ... - send buffer to send multiple commands in one TCP packet - recv/send operation size now based on bandwith limit - send queue limited to 100 entries - buffer getdata commands to fill send queue, instead of waiting for the data packet to arrive first (i.e. allow getdata to work asynchronously)	2017-01-15 15:08:03 +01:00
Peter Surda	c3fef7bc4e	Syntax fix	2017-01-15 12:41:19 +01:00
Peter Surda	9bf17b34d1	Remove obsolete imports and code ... - landscape.io pointed out obsolete imports - there is also an obsolete variable and lock in throttle.py - add Exception type to BMConfigParser().save	2017-01-15 11:40:31 +01:00
Peter Surda	8cb0953401	Moved writeKeysFile into configparser ... - shared.writeKeysFile -> BMConfigParser().save - makes it easier to get rid of circular imports	2017-01-15 10:50:02 +01:00
Peter Surda	5ca8a52662	Typos, extra imports and similar ... - pointed out by landscape.io - also updated dev/ssltest.py to work the same way as the main program	2017-01-15 10:48:29 +01:00
Peter Surda	689d697a40	Refactor bandwidth limit and speed calculator ... - also fixes potential deadlocks	2017-01-14 23:21:00 +01:00
Peter Surda	ad75552b5c	Move shutdown from shared.py to state.py	2017-01-14 23:20:15 +01:00
Peter Surda	bcc7692e14	Add safeGetInt to BMConfigParser	2017-01-14 23:18:06 +01:00
Peter Surda	02a7c59de8	OpenSSL 1.1.0 compatibility fixes ... - part 2, continued from previous commit	2017-01-14 17:50:49 +01:00
Peter Surda	59b5ac3a61	OpenSSL 1.1.0 compatibility fixes ... - function check missed 1.1.0 release - TLS didn't work with anonymous ciphers	2017-01-14 17:47:57 +01:00
Peter Surda	fa2f87743e	SSL handshake fix ... - SSL handshake would often fail, because verack packet was being sent at the same time as the do_handshake was executed in a different thread. This makes it so that do_handshake waits until verack is done sending. - also minor modifications in SSLContext initialisation	2017-01-14 13:22:46 +01:00
Peter Surda	cc4c07025b	Sending thread fix	2017-01-14 12:35:08 +01:00
Peter Surda	8d278182a7	Indentation	2017-01-13 15:53:47 +01:00
Peter Surda	93bdc3c800	Remove extra print	2017-01-13 12:32:26 +01:00
Peter Surda	d0b1cbfe1f	Add current git HEAD info to support request	2017-01-13 12:29:14 +01:00
Peter Surda	5ae676f2ad	Minor support fix	2017-01-13 12:05:39 +01:00
Peter Surda	6778d6046f	Add OpenSSL 1.1.0 compatibility ... - thanks to Wolfgang Frisch <wfr@roembden.net>	2017-01-13 12:02:34 +01:00
Peter Surda	59cf33c9a1	Remove obsolete import	2017-01-13 12:01:38 +01:00
Peter Surda	65701e5997	neededPubkeys fix ... - was still using shared.neededPubkeys	2017-01-13 09:30:23 +01:00
Peter Surda	ff8deebf60	Keep track of network protocol status	2017-01-12 19:18:56 +01:00
Peter Surda	810e50a040	Fix minor issues ... - landscape.io complained - obsolete imports - ciphers -> self.ciphers	2017-01-12 07:26:04 +01:00
Peter Surda	2cf2188bc3	Object sending fix ... - forgot to move broadcastToSendDataQueues in class_singleWorker.py	2017-01-12 07:22:34 +01:00
Peter Surda	bd520a340f	Trustedpeer fix and more refactoring ... - fixed trustedPeer (thanks to anonymous bug reporter) - moved trustedPeer and Peer into state.py	2017-01-12 06:58:35 +01:00
Peter Surda	e7470a4757	Remove leftover from debugging	2017-01-12 06:57:17 +01:00
Peter Surda	5ceb920bd6	TLS tuning ... - allow TLS > 1.0 with python >= 2.7.9 - tune ssl_context with python >= 2.7.9	2017-01-11 20:47:27 +01:00
Peter Surda	c738d93056	Assorted fixes ... - landscape.io was complaining, this fixes most easily fixable errors	2017-01-11 18:13:00 +01:00
Peter Surda	cdcdf11d59	Missing import fix	2017-01-11 17:46:33 +01:00
Peter Surda	fa0a3135e7	Fixes pointed out by landscape.io ... - missing/wrong/obsolete imports - logger formatting	2017-01-11 17:26:25 +01:00
Peter Surda	ac348e4e6b	Fixes and refactoring ... - fixes errors introduced in the earlier refactoring - more variables moved to state.py - path finding functions moved to paths.py - remembers IPv6 network unreachable (in the future can be used to skip IPv6 for a while)	2017-01-11 17:00:00 +01:00
Peter Surda	5d2bebae28	Add IPv4 multicast range to ignored addresses	2017-01-11 14:46:10 +01:00
Peter Surda	8bcfe80ad0	Refactoring of config parser and shared.py ... - got rid of shared config parser and made it into a singleton - refactored safeConfigGetBoolean as a method of the config singleton - refactored safeConfigGet as a method of the config singleton - moved softwareVersion from shared.py into version.py - moved some global variables from shared.py into state.py - moved some protocol-specific functions from shared.py into protocol.py	2017-01-11 14:27:19 +01:00
Peter Surda	085e335969	Proxy update (for the new network subsystem)	2017-01-10 21:22:22 +01:00
Peter Surda	75090abaaf	Advanced dispatcher class ... - generic class the new asyncore-based network subsystem that handles buffered data transfer	2017-01-10 21:20:49 +01:00
Peter Surda	b4703ec6ce	Make objectHashHolder into a list ... - was a dict	2017-01-10 21:19:57 +01:00