Add support for Freetrade

Added

Support for Freetrade

As an aside, this is a smaller part of a bigger PR I've been working on in my fork which resolves a few issues and niggles I encountered when trying to add support for Freetrade. I know things like rearranging a repo can step on toes so I've left this PR to be solely about adding Freetrade as the repo stands.
If you like all the changes in my other PR and are happy to accept them, I'm happy to close this PR in favour of that one, or split it up into a number of smaller easier to review PRs.

Thanks for the PR (both actually). I will look into this in more detail soon (currently planning on Tuesday)!

Overall a good PR, a few small things I left in review for you to look at.
I also took a look at your other PR.  The current setup was a merge of two separate converters and it has become somewhat cluttery (regarding the sample files). I want to propose to do both PR's separatly.  This way this new feature can be added first, and then I can review the reorganisation separatly. I do have some questions about that PR, so I'll add them there.

Merged! Thanks for the contribution!
I added comments to your draft PR, feel free to open it as a merge to this repo!

🤔 I'm not seeing your comments

Hold off. I'm going to open a new PR as I can't rebase back to this repo.

🤔 I'm not seeing your comments

Did you manage to find them?

Ah, you've not finished the review - note the "Pending". You need to click the "Review changes" button on the "Files changed" tab. I won't be able to see review comments until then.

I have added them manually to the new PR.

Still not seeing them 😬


Question about 'Cumulative returns' calculation in tear sheets

Problem Description
Please provide a minimal, self-contained, and reproducible example:
import empyrical as emp
import numpy as np

b = np.array([1,2,3])

print(emp.cum_returns_final(b))
print(np.nanprod(b+1, axis=0)-1)
print(np.prod(b+1)-1)

Please provide the full traceback:
no traceback

Please provide any additional information below:
I have a question about the “cumulative returns” stat this is reported in the tear sheets.
I noticed that the stat doesn’t appear to be the cumulative sum of the returns. Looking at the code, in the timeseries.py script, on line 653, I saw that the tear sheet calls the cum_returns_final function from the empyrical package when it calculates the cumulative returns. The empyrical documentation says it computes the “total returns from simple returns.”
That function seems to add 1 to each element in the array of returns, calculate the product of the returns, and then subtract 1 at the end. It does this, rather than just calculating the cumulative sum. I tested my hunch out a couple different ways, using the code above.
Am I correct about how the cumulative returns stat is calculated? If so, could you explain why this is done, instead of just calculating the cumulative sum? Or provide me with a term to google, so I can look it up? Is it something to do with compounding? Thanks, -Joe
Versions

Pyfolio version: 0.9.0
Python version: 3.7.1
Pandas version: 0.23.4
Matplotlib version: 3.0.2

Pyfolio returns are daily simple returns, so combining periods is through prod()
If it were daily log returns, then combining would be through sum()
Here is the relevant line from the empyrical package:
https://github.com/quantopian/empyrical/blob/b561c5fd2d299590a45c870868e84c6060a50c1d/empyrical/stats.py#L262

https://www.kellogg.northwestern.edu/rc/workshops/cumulative_returns.htm


Publisher write call blocks or fails when a new subscriber is started later [7833]

Expected Behavior
The publisher's write call should not block excessively or fail when a new subscriber is started.
Current Behavior
I have a publisher regularly writing e.g. at 100Hz, with reliable QoS, keep-last, depth 1.
Some minutes later, I start a subscriber to it. The publisher's write call then blocks for many milliseconds, sometimes over 100ms, resulting in failure. This only happens once, when the subscriber is started, after which it returns to normal.
Steps to Reproduce
I have a simple ROS2 test publisher that keeps statistics of how long each publish call takes, and prints out when it's high.
https://github.com/aquad/test_pub_blocking_time

Create publisher running at 1000Hz:
ros2 run test_pub_blocking_time test_pub_blocking_time --rate 1000
Wait 1 minute.
Create subscriber: ros2 topic hz /test_topic

With the above wait, it blocks for ~15ms. Waiting longer increases the blocking time.
System information

Fast-RTPS version: 1.8.0
OS: Ubuntu 18.04
Network interfaces: lo (<IP_ADDRESS>)
ROS2: Dashing

Diagnosis
Within PublisherImpl::create_new_change_with_params(), the mp_writer mutex is try-locked, which blocks, waiting on another thread. If it reaches 100ms, it will fail and return.
It is waiting on the mutex lock at StatefulWriter::send_any_unsent_changes(). Most of the time in this function is spent on handling a very large std::set<SequenceNumber_t> in notRelevantChanges (e.g.  size over 100000), around RTPSMessageGroup::add_gap(),
The set is created at StatefulWriter::send_any_unsent_changes():
remoteReader->for_each_unsent_change(max_sequence, unsent_change_process);

The remoteReader (ReaderProxy) stores a SequenceNumber_t changes_low_mark_ member, and it has to iterate from there to max_sequence (can be hundreds of thousands), adding elements to the std::set.  When you create a new subscriber, it results in a new ReaderProxy, with changes_low_mark_ = 0, and thus a giant std::set.
So the issue comes down to handling 'gap' submessages in the DDS RTPS spec. Gap submessages are meant to communicate the range/list of sequence numbers that are no longer relevant. However, if the minimum sequence number in the history is 100000 when the ReaderProxy is created, I don't think it needs to create a gap submessage saying messages 0-100000 are no longer valid. The DDS RTPS spec document seems to indicate that any sequence number to put in a gap message is triggered from the_reader_proxy.next_requested_change() or the_reader_proxy.next_unsent_change(). I.e. a real current sequence number.
The FastRTPS code dealing with gap messages was actually changed significantly in v1.9, to no longer use an std::set.  It now has a dedicated RTPSGapBuilder class, which does things more efficiently. Running the above blocking test with ROS2 foxy (v1.9.X) shows the blocking duration to not spike there. So perhaps this can be considered fixed in 1.9. Though it still looks to be iterating through all the way from 0, so the below fix might still be an improvement in 1.9.
Fix
diff --git a/src/cpp/rtps/writer/ReaderProxy.cpp b/src/cpp/rtps/writer/ReaderProxy.cpp
index ba6d8635..13c856e7 100644
--- a/src/cpp/rtps/writer/ReaderProxy.cpp
+++ b/src/cpp/rtps/writer/ReaderProxy.cpp
@@ -70,7 +70,23 @@ void ReaderProxy::start(const RemoteReaderAttributes& reader_attributes)
     nack_supression_event_->reader_guid(reader_attributes_.guid);
     timers_enabled_.store(reader_attributes_.endpoint.reliabilityKind == RELIABLE);

     logInfo(RTPS_WRITER, "Reader Proxy started");
+    // The remote reader shouldn't care about sequence ids prior to the first
+    // one it receives.
+    SequenceNumber_t min_seq = writer_->get_seq_num_min();
+    if (min_seq != c_SequenceNumber_Unknown)
+        changes_low_mark_ = min_seq - 1;
+    else
+        changes_low_mark_ = writer_->next_sequence_number() - 2;
+    changes_low_mark_ = std::max(changes_low_mark_, SequenceNumber_t());
 }

It seems to work, the blocking duration no longer spikes. Though it turns out that the writer history is empty in many cases (get_seq_num_min is unknown), so we have to use next_sequence_number() as above.
Again, I'm not 100% sure if this is compliant with the RTPS spec.

Hi @aquad , and lots of thanks for your thorough description of the issue!
We were able to reproduce your issue in 1.8.2 (current ROS 2 Dashing). Even though the performance has significantly improved since 1.8.x, the issue will raise anyways if a later joiner appears not minutes but hours in the publication (meaning millions of changes).
For this reason, we have made a fix for master based on your idea (see #1045). What we've done is to simulate an the arrival of an initial acknack on ReaderProxy::start(), so that the ReaderProxy's low mark is set correctly. We are currently studying the migration of the fix to previous versions.
Again, thanks a lot!

@aquad #1072 has been merged on branch 1.8.x, and should fix your problem

Great, thanks!


Scrreen space reflections does not seem to actually take roughness into account

Godot version:

3.3.2
OS/device including version:

NVIDIA GeForce GTX 1660, (dont know how to check driver on windows), GLES3 backend, graphics-related(minor issue)
Issue description:
With SS reflections enabled, Godot does not seem to actually take roughness into account because toggling the option in SS reflections does not seem to change anything. Reflections are clear even though the material have 0 metalness and 1 roughness.
Roughness on:

Roughness off:

Increased max steps for better visibility:

Steps to reproduce:

Enable SS reflections in the world environment you are using.
Create a flat plane to act as the mirrer.
2.1 Create a material for the plane and make the albedo dark. This makes it easier to see the reflections
Put something above it to be reflected.
You can see very defined reflections despite the material having roughness of 1

Minimal reproduction project:

I am unable to upload the .zip file of the project for some reason(see screenshot below) so I uploaded it to Google drive. Alternatively, this issue can be reproduced even on a fresh new project. https://drive.google.com/file/d/1WQf1LtvKwxayaSobqT5LEGSMJxOp7NRG/view?usp=sharing

I'm not sure if rough reflections were ever supported in the 3.x branch. They are supported in the master branch's Vulkan renderer (nonwithstanding this bug).

I'm not sure if true rough reflections were ever supported in the 3.x branch. Instead, enabling roughness will just make SSR fade faster depending on the material's roughness.

Why is that though?
By the way, I googled about rough reflections and found another issue that seem to be the same as this one(#25112) but it's for a beta of 3.1 and at least a year old. Do I close this one or keep it open?

Why is that though?

The renderer in Godot 3.x is more limited than the one in the master branch. It's based on OpenGL ES 3.0 (which itself is more limited than Vulkan).


clepy: 0.3.20 -> 0.3.23

Motivation for this change
Fixes build failures.
related to #28643
Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option build-use-sandbox in nix.conf on non-NixOS)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] Linux

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[x] Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[x] Fits CONTRIBUTING.md.

I prefer to remove this package https://github.com/NixOS/nixpkgs/pull/29461

The package has been removed in #29461


Template Model

Make the repository follow the template of the other repositories

Remove all directories and files other than src.

Done in 8.0.0


Add doc for Tag#name if no tag name is supplied

Description
Added documentation for YARD::Tags::Tag#name, which could be nil.
The following is a typical example.
YARD::DocstringParser.new.parse("@return [void]").tags
#=> [#<YARD::Tags::Tag:0x0000000105294108 @name=nil, @tag_name="return", @text="", @types=["void"]>]

Completed Tasks

[x] I have read the Contributing Guide.
[x] The pull request is complete (implemented / written).
[x] Git commits have been cleaned up (squash WIP / revert commits).
[x] I wrote tests and ran bundle exec rake locally (if code is attached to PR).

Makes sense, thanks!


Example with just the Graphics part ?

Hello,
I was wondering if it would be easy to use the code just for the rendering part. No computation, event, or input/output type management, etc.
As a matter of fact I have my own processing graph library and with no GUI and just wanted to use a graphical editor to add/delete nodes and links.
Would it be possible to add an example with just the node/link rendering alone ? Or is it just not possible just to use the rendering part ?
Thank you.

Hi,
You could write one empty dummy model and one dummy datatype. And write absolutely no data processing code. This would take up 20 lines of code.
The rest should work -- you will be able to connect everything to everything. I can elaborate on that in a couple of days.
Best,
Dmitry

Well, thank you for answering.
I haven't even considered this solution in the first place :smile:
Great project, btw.


General Refactoring

The current code base, while good, is far from accessible to others and includes a high learning curve.
Refactoring it so that it becomes more

OO like
accessible
maintainable
unit testable

might increase overall acceptance of this "beast".
See initial efforts in branch https://github.com/pana-cc/mocha-typescript/tree/gh-154
which is WIP (work in progress).

Closing for now as we are currently heading into a different direction.


DOM Element handling

Proposition for handling DOM Element as first argument for fromHTML. The only difference in that case is that the fromHTML returns references to DOM not new Elements.

Hi @kociolekt , thx for taking the time to contribute! I had actually considered something like this, but rejected it for now because I think it's somewhat arbitrary why in one case the HTML is getting copied, in another case the reference to the original container element is kept... so we'd probably need an option for that, or check if the element is of type text/template or something like that.
And on a more general note, I'm not even sure if this is a good idea in the first place. Like, if you want to actually query the existing DOM, you should do so explicitly, not by adding (possibly even non-standard) custom attributes to the markup... SOC and all. Allowing for templates seemed a viable compromise to me.
Anyway if you do want to query the DOM like that, you can actually do so already by simply assigning IDs to the elements; these can then accessed directly via the window object:

foo

bar

const { foo, bar } = window

Granted, this isn't ideal either as it's not entirely transparent that these are supposed to be references to HTML elements. I'm of course open for discussion though -- just open an issue! :-)
Cheers,
Sebastian
PS: Please check the .eslintrc.json too -- I just added a contributing note. Didn't expect any PRs TBH haha!

Ii @m3g4p0p thanks for reply! You have a point :-) The different behaviour worries me too so I'm not going to be stubborn ;-) It's just a proposition.
I work a lot with backend generated views but I'm also sharing loads of partial views across backend and frontend. Writing modules with templates and trying to avoid jquery becomes hell. And that's where fromHtml hit the spot for me. Just in my case the mixed behaviour is the one I was looking for - already forked it ;)
I'm being on search for best solutions in subject of js/css/html separation. Just recently I've been writing OOP in js with jquery for DOM search and manipulation. BEM in styles. In views I'm forced to use twig. Up until now I've been connecting presentation with logic using classes e.g. js-some-feature some-feature. Where js-some-feature was for js and some-feature for css. But with BEM the class attributes are already ridiculously long. Using id's is not a bad idea but then there are mixed selectors - id's for unique features and classes for list of elements for example. So in the next project I'm going to use custom properties or at least something like data-ref.
Thanks for great module!
Tomek

Cool, great to hear it's of some use for you already! :-)
BTW another thing to consider (also if you just keep the fork) is that by default this would actually modify the DOM (namely remove the ref attributes)... I guess this is usually not what you want.
Anyway, I can see the use case here... I'm wondering though if this might not even be worth a dedicated library (or at any rate a dedicated export) with extended DOM query options (e.g. mapping js- prefixed classes to camel-cased property names)...

Cool, great to hear it's of some use for you already! :-) And yeah I can see the use case here...
Anyway another thing to consider (also if you just keep the fork) is that by default this would actually modify the DOM (namely remove the ref attributes)... I suppose this is usually not what you want in this case.


nuxt-img component enhancement and console error

Your newly added feature to support nuxt generate images  works almost fine after deployment to netlify but in my a console error I see an error (which breaks e.g. @mouseleave="someFunc").

images get displayed
but error break some nuxt functions

a bit it looks related to an ES6 or ES5 issue in the component for nuxt-img but i am ont sure if this could be related to the combo with nuxt-pwa (Serviceworker).
maybe some include condition which isn´t browser valid or correctly transformt
Further, I would like to add a class to the img via :class  but this wasn´t inherited to the component.
Finally i still have to generate image locally and commit them, have you faced this issue as well @barryrld  ?

Hi @dev7ch
I've been adding end-to-end tests to this package and I was able to duplicate the "Cannot read property of 'includes' of undefined" bug. This is now fixed in the latest version 1.1.1 on npm.
As for the class issue, let's leave this issue open. There's an more optimal way, I'm sure, to pass through any attributes not explicitly needed by the <nuxt-img> component. Please leave this with me.
As for:

Finally i still have to generate image locally and commit them

Again, please try again with v1.1.1 as you may find this is now fixed.
Thanks,
Barry

Hey @barryrld thank you for the detailed reply! sorry for mixing issues.
regarding :class perfect.
i ll updated within the next 2 days as you mentioned and report it here.

Hi @dev7ch
The passing of class and style attributes in the <nuxt-img> component is now fixed in version 1.1.2 for both a static string or a data binding with v-bind.
I'd appreciate your feedback to confirm this is fixed in your 'real world' project when you get a chance. The commit automatically closed this issue, so please feel free to open if you're still having an issue with this.
Thanks,
Barry


✨ unpack local image file

What this PR does / why we need it:
bundles.RunBundles currently does not support reading image tar files from the filesystem and unpacking it into target location. This PR adds support for it.
Which issue(s) this PR fixes (optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close the issue(s) when PR gets merged):
Fixes #799
Depends on - https://github.com/mudler/luet/pull/318 this PR also being merged.
And also the luet dependency will need to be updated.

Codecov Report

Merging #803 (c481938) into master (b7c6d1e) will decrease coverage by 0.22%.
The diff coverage is 0.00%.

:exclamation: Current head c481938 differs from pull request most recent head 05b68c1. Consider uploading reports for the commit 05b68c1 to get more accurate results

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more
@@            Coverage Diff             @@
##           master     #803      +/-   ##
==========================================
- Coverage   19.66%   19.45%   -0.22%
==========================================
  Files          18       18
  Lines        1439     1455      +16
==========================================
  Hits          283      283
- Misses       1108     1124      +16
  Partials       48       48

Impacted Files
Coverage Δ

sdk/bundles/bundles.go
33.73% <0.00%> (-3.60%)
:arrow_down:

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more

I wouldn't expect a new type here, but rather all of the bundles types to accept local files instead. for instance the run bundle could work as well with local images, as, the default container one.

it would become a little odd if bundleConfig.Target looks like container://file://home/san/alpine.tar
In the BundleConfig, is it fine to introduce localFile bool to indicate the target is a file on the filesystem?

it would become a little odd if bundleConfig.Target looks like container://file://home/san/alpine.tar
In the BundleConfig, is it fine to introduce localFile bool to indicate the target is a file on the filesystem?

yup that looks good here :+1: just note you might need that to be public to be able to unmarshal it

the install-test failure is a well known #742

I've tagged a new version of luet, however it needs bump in the kairos images @santhoshdaivajna


discovery/resource.rb:58 wrong number of arguments (1 for 0)

I'm trying to pull the ads list and I'm using code that is similar to the sample Ruby code provided.
Below is the code I am trying to run:
# Construct the request
request = dfareporting.ads.list(
  :active => true,
  :profileId => profile_id,
  :advertiserId => advertiser_id
)

loop do
  result = request.execute()

  # Display results
  result.data.ads.each do |ad|
    puts 'Found ad with ID %d and name "%s".' % [ad.id, ad.name]

  end

  token = result.next_page_token

  break unless token and result.data.ads.any?
  request = result.next_page
end

I get the  following error:
wrong number of arguments (1 for 0)
/Users/ryost/.rvm/gems/ruby-2.2.1/gems/google-api-client-0.8.6/lib/google/api_client/discovery/resource.rb:58:in block (2 levels) in initialize' /Users/ryost/Documents/repositories/nightingale/app/workers/dcm_get_dimensions.rb:24:in get_ads'
/Users/ryost/Documents/repositories/nightingale/app/workers/dcm_get_dimensions.rb:13:in perform' /Users/ryost/.rvm/gems/ruby-2.2.1/gems/sidekiq-4.0.2/lib/sidekiq/processor.rb:150:in execute_job'
/Users/ryost/.rvm/gems/ruby-2.2.1/gems/sidekiq-4.0.2/lib/sidekiq/processor.rb:132:in block (2 levels) in process' /Users/ryost/.rvm/gems/ruby-2.2.1/gems/sidekiq-4.0.2/lib/sidekiq/middleware/chain.rb:127:in block in invoke'
/Users/ryost/.rvm/gems/ruby-2.2.1/gems/sidekiq-4.0.2/lib/sidekiq/middleware/server/retry_jobs.rb:74:in call' /Users/ryost/.rvm/gems/ruby-2.2.1/gems/sidekiq-4.0.2/lib/sidekiq/middleware/chain.rb:129:in block in invoke'
/Users/ryost/.rvm/gems/ruby-2.2.1/gems/sidekiq-4.0.2/lib/sidekiq/middleware/server/logging.rb:11:in block in call' /Users/ryost/.rvm/gems/ruby-2.2.1/gems/sidekiq-4.0.2/lib/sidekiq/logging.rb:30:in with_context'
/Users/ryost/.rvm/gems/ruby-2.2.1/gems/sidekiq-4.0.2/lib/sidekiq/middleware/server/logging.rb:7:in call' /Users/ryost/.rvm/gems/ruby-2.2.1/gems/sidekiq-4.0.2/lib/sidekiq/middleware/chain.rb:129:in block in invoke'
/Users/ryost/.rvm/gems/ruby-2.2.1/gems/sidekiq-4.0.2/lib/sidekiq/middleware/chain.rb:132:in call' /Users/ryost/.rvm/gems/ruby-2.2.1/gems/sidekiq-4.0.2/lib/sidekiq/middleware/chain.rb:132:in invoke'
/Users/ryost/.rvm/gems/ruby-2.2.1/gems/sidekiq-4.0.2/lib/sidekiq/processor.rb:127:in block in process' /Users/ryost/.rvm/gems/ruby-2.2.1/gems/sidekiq-4.0.2/lib/sidekiq/processor.rb:166:in stats'
/Users/ryost/.rvm/gems/ruby-2.2.1/gems/sidekiq-4.0.2/lib/sidekiq/processor.rb:126:in process' /Users/ryost/.rvm/gems/ruby-2.2.1/gems/sidekiq-4.0.2/lib/sidekiq/processor.rb:79:in process_one'
/Users/ryost/.rvm/gems/ruby-2.2.1/gems/sidekiq-4.0.2/lib/sidekiq/processor.rb:67:in run' /Users/ryost/.rvm/gems/ruby-2.2.1/gems/sidekiq-4.0.2/lib/sidekiq/util.rb:16:in watchdog'
/Users/ryost/.rvm/gems/ruby-2.2.1/gems/sidekiq-4.0.2/lib/sidekiq/util.rb:24:in `block in safe_thread'
It looks like the method I'm using does expect more than one param, plus it's the way in the sample code. But there's something deeper in the ruby gem that does not.
First, I'm I coding this wrong and not seeing it? Or is there an error in the gem? If there is an error, is there a work around?
Thanks!

What was line 24 in your dcm_get_dimensions.rb file?

That's this line:
request = dfareporting.ads.list(
:active => true,
:profileId => profile_id,
:advertiserId => advertiser_id
)

Looks like you're mixing calling styles in the API - you're using the service-style calls, but not actually creating the service correctly.
My hunch is you have some code before that which looks like:
client = Google::APIClient.new
dfareporting = client.discovered_api('dfareporting', 'v2.3')

That was the only way I could reproduce that error (and the only way it would make sense from looking at the code.)
Given the way the rest of the code looks, you should have something like:
dfareporting = Google::APIClient::Service.new('dfareporting', 'v2.3')

Starting with 0.9 there's only way to do things so it should be simpler. If you want to migrate to 0.9, the code would look something like (note: I haven't actually run this, so may contain errors ;)
require 'google/apis/dfareporting_2_3/'

dfa = Google::Apis::DfareportingV2_3:: DfareportingService.new
dfa.authorization = ... # your credentials

next_page_token = nil
loop do
  result = dfa.list_ads(profile_id, active: true, advertiser_id: advertiser_id, page_token: next_page_token)
  # Display results
  result.ads.each do |ad|
    puts 'Found ad with ID %d and name "%s".' % [ad.id, ad.name]
  end

  next_page_token = result.next_page_token
  break if next_page_token.nil?
end


Issue with classification from sd-file

Environment:
Win Server 2012 R2 64-bit
Python 3.6 (Anaconda)
CPU
I'm trying to do a binary classification from an sd-file. The sd-file has only 1 data property, the class with values 0 or 1.
I'm following this example (own-dataset) adjusted for classification.
When calling trainer.run() I get below error:

C:\Program Files\Anaconda3\envs\chainer\lib\site-packages\chainer\utils\type_check.py in expect(self)
480             raise InvalidType(
481                 '{0} {1} {2}'.format(self.lhs, self.exp, self.rhs),
--> 482                 '{0} {1} {2}'.format(left, self.inv, right))
483
484
InvalidType:
Invalid operation is performed in: SigmoidCrossEntropy (Forward)
Expect: in_types[1].dtype.kind == i
Actual: O != i

Looks like an issue with the class labels?
The code:
preprocessor = preprocess_method_dict['ggnn']()
parser = SDFFileParser(preprocessor, labels="Class")
dataset = parser.parse('path\to\mymolecules.sdf')["dataset"]

train_data_ratio = 0.8
seed = 777
train_data_size = int(len(dataset) * train_data_ratio)
train, val = split_dataset_random(dataset, train_data_size, seed)

n_unit = 16
conv_layers = 4
class_num = 1 # only 1 target
batch_size = 32
epochs = 20

model = GraphConvPredictor(GGNN(out_dim=n_unit, hidden_dim=n_unit,
                                        n_layers=conv_layers),
                                   MLP(out_dim=class_num, hidden_dim=n_unit))

train_iter = iterators.SerialIterator(train, batch_size)
val_iter = iterators.SerialIterator(
        val, batch_size, repeat=False, shuffle=False)

device = -1 #CPU

classifier = Classifier(model, lossfun=F.sigmoid_cross_entropy, metrics_fun=F.f1_score, device=device)

optimizer = optimizers.Adam()
optimizer.setup(classifier)

updater = training.StandardUpdater(train_iter, optimizer, device=device, converter=concat_mols)

trainer = training.Trainer(updater, (epochs, 'epoch'), out='Prediction')
trainer.extend(E.Evaluator(val_iter, classifier, device=device,
                           converter=concat_mols))
trainer.extend(E.snapshot(), trigger=(epochs, 'epoch'))
trainer.extend(E.LogReport())
# Note that original scale absolute errors are reported in
# (validation/)main/abs_error
trainer.extend(E.PrintReport(['epoch', 'main/loss', 'main/abs_error',
                              'validation/main/loss',
                              'validation/main/abs_error',
                              'elapsed_time']))
trainer.extend(E.ProgressBar())
trainer.run()

What am I doing wrong? Is it an issue with the class lables? I'm not seeing were I should explicitly pass them in.

I changed the parser to:
parser = SDFFileParser(preprocessor, labels=["Class"], postprocess_label=postprocess_label)
with the postprocess method being a copy&paste from your link. I know get this different error:
`InvalidType:
Invalid operation is performed in: ClassificationSummary (Forward)
Expect: in_types[0].shape[2:3] == in_types[1].shape[1:]
Actual: () != (1,)`

Does the same error happen if you use the sdf file of tox21 dataset supported in chainer chemistry?
(you can get file path of tox21 by get_tox21_filepath)
I think your code should work only changing one line data.load_dataset, into your sdf file loading from original tox21 training example.
https://github.com/pfnet-research/chainer-chemistry/blob/master/examples/tox21/train_tox21.py#L93

I changed the dataset to:
from chainer_chemistry.datasets.tox21 import get_tox21_filepath
labels = ['NR-AR']

path = get_tox21_filepath('train')
preprocessor = preprocess_method_dict['ggnn']()
parser = SDFFileParser(preprocessor, labels=labels, postprocess_label=postprocess_label)
dataset = parser.parse(path)["dataset"]

Still get same error:

InvalidType:
Invalid operation is performed in: ClassificationSummary (Forward)
Expect: in_types[0].shape[2:3] == in_types[1].shape[1:]
Actual: () != (1,)

In that case the problem is not in sdf file itself, but your train code some how differs from train_tox21.py example code
https://github.com/pfnet-research/chainer-chemistry/blob/master/examples/tox21/train_tox21.py#L93
Can you run this tox21 example code above? (If it works, you can modify a little bit from this code to use your own dataset.)

Ok, the issue was with the metric:
classifier = Classifier(model, lossfun=F.sigmoid_cross_entropy, metrics_fun=F.binary_accuracy, device=device)
I had f1_score but only binary_accuracy can be used, else the error happens.

Good, so you could run your training script now!? Can we close the issue?


Use SPDX license identifier

Before this change, npm install would give the following warning:
$ npm install
npm WARN package.json<EMAIL_ADDRESS>No license field.

According to https://docs.npmjs.com/files/package.json#license
"licenses" has been deprecated by "license".

Thanks for the PR and the link to the docs. Didn't know about SPDX yet.


On delete task, no confetti added.

Closes #44.

@SaraswatGit Please have a look at this!

@Aniket-508  I have merged your PR Gr8 work .


Ensure resources are closed in GarbageCollectWriteAheadLogs

Fixes #4753
The changes in this PR were closely modeled after the changes in #4207
This PR:
moves some of the logic out of the GarbageCollectWriteAheadLogs constructor and into separate methods
These new methods are createWalStateManager() and createStore(). Moving this logic into separate methods allows us to override these methods for testing. It also makes it easier to construct the collection of TabletLocationState that is used in the collect() method.
Creates TabletStateStore.stream()
This new method returns a Stream<TabletLocationState> that is created off of the ClosableIterator<TabletLocationState> iterator(). The goal of this PR is to make sure that these ClosableIterator<TabletLocationState> objects are closed so the stream adds an onClose() for this.
This stream method lets us more easily concatonate and then close multple streams of TabletLocationState that are returned in GarbageCollectWriteAheadLogs.createStore().
Adds a AtomicBoolean hasCollected to ensure that GarbageCollectWriteAheadLogs.collect() is only ever called once.
This is important because the resources will be closed after they are read.

@cshannon, @kevinrr888, @ctubbsii, all of your suggestions/questions should be addressed now.


TASK-3_1: Refactor blockchain related repositories

Refactor blockchain-related repositories codes to make them easier to read and maintain

Small changes, ok to merge


Added broken image handling

Added broken image handling
Simplified return

When the image is broken Image.resolveAssetSource returns 0 for both the height and the width properties. As a result, we have an Infinity as a ratio.


Update CNI to v1.2.0

Replaces #10080 with change for deprecation checker

@MikeZappa87 FYI partial upgrade happened here.. missed it.


error :(

make

Compiling bktrace.cc ...
In file included from ulimits.h:7:0,
from bktrace.h:7,
from bktrace.cc:6:
utypes.h:12:6: error: #error "This library requires standard UNIX headers to compile."
#error "This library requires standard UNIX headers to compile."
^
make: *** [.o/bktrace.o] Error 1

This error indicates that the configure script could not find one of the required headers fcntl.h, sys/stat.h, or unistd.h. All UNIX systems, such as Linux, BSD, SunOS, or Solaris, have these headers installed in /usr/include. Please verify that they are there and that you did not tell configure to look elsewhere by specifying --prefix, --includedir, and --oldincludedir as somewhere else. If you are not compiling on a UNIX system, such as Windows, please read the uSTL web page, where Windows is explicitly listed as not supported, for this and many other reasons.

Closing due to submitter's lack of interest.


Clarify in documentation what gas_price really means

/cc @bertmiller

Can we merge main into this and then merge this PR @epheph ?

Updated branch


Allow building with native-tls instead of rustls

Bundling (static linking) TLS library is a very bad idea from a security perspective and linux distributions try to avoid it.

Codecov Report

Merging #258 (848515a) into master (728bf25) will decrease coverage by 0.00%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master     #258      +/-   ##
==========================================
- Coverage   94.21%   94.20%   -0.01%
==========================================
  Files         454      454
  Lines       16341    16343       +2
==========================================
+ Hits        15395    15396       +1
- Misses        946      947       +1

Impacted Files
Coverage Δ

duckscript_sdk/src/sdk/std/net/ftp/get/mod.rs
89.28% <0.00%> (-1.79%)
:arrow_down:

duckscript_sdk/src/sdk/std/net/ftp/list/mod.rs
97.05% <0.00%> (+0.08%)
:arrow_up:

duckscript_sdk/src/sdk/std/net/ftp/nlst/mod.rs
97.05% <0.00%> (+0.08%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 728bf25...848515a. Read the comment docs.

@jirutka thanks a lot. i got a lot of requests to stop using the native openssl due to installation difficulties, but i see no harm in giving both options.


OS Requirements

What are the OS requirements? Do I need a GPU or can I run the model on a CPU?
The main error I'm getting:
Traceback (most recent call last):   File "auto_tinder.py", line 138, in <module>     detection_graph = person_detector.open_graph()   File "/home/dario/dev/tinder/py37-venv/auto-tinder/person_detector.py", line 56, in open_graph     od_graph_def = tf.GraphDef() AttributeError: module 'tensorflow' has no attribute 'GraphDef'
after already installing the tensorflow person detector api via:
pip install tensorflow-object-detection-api

In my case I had the same problem because I was using Tensorflow 2, so you need to change as follows:
tf.GraphDef() --> tf.compat.v1.GraphDef()
tf.gfile.GFile() --> tf.compat.v2.io.gfile.GFile()


Fix Nodejs version table

It lists Node 6 as recommended, so it seems outdated

The referent of "it" is unclear.  Which Nodejs version table?

The one halfway down this page: https://cnc.js.org/


flowd_aggregate crash

Netflow crashes after a minute or two. Not sure, but the problem occurs after adding an additional interface via "Interfaces: Assignments" for ovpns1. Maybe there is a 'corpse' in a config file now?!
Output:
root@OPNsense:~ # /usr/local/opnsense/scripts/netflow/flowd_aggregate.py --console
Traceback (most recent call last):
File "/usr/local/opnsense/scripts/netflow/flowd_aggregate.py", line 224, in
Main()
File "/usr/local/opnsense/scripts/netflow/flowd_aggregate.py", line 136, in init
self.run()
File "/usr/local/opnsense/scripts/netflow/flowd_aggregate.py", line 160, in run
aggregate_flowd(self.config, do_vacuum)
File "/usr/local/opnsense/scripts/netflow/flowd_aggregate.py", line 68, in aggregate_flowd
for flow_record in parse_flow(prev_recv, config.flowd_source):
File "/usr/local/opnsense/scripts/netflow/lib/parse.py", line 74, in parse_flow
for flow_record in FlowParser(filename, recv_stamp):
File "/usr/local/opnsense/scripts/netflow/lib/flowparser.py", line 139, in iter
data_fields=ntohl(header[3])
File "/usr/local/opnsense/scripts/netflow/lib/flowparser.py", line 118, in _parse_binary
raw_data[raw_data_idx:raw_data_idx + fsize]
struct.error: unpack requires a buffer of 8 bytes
root@OPNsense:~ #
I tried to reset and repair via GUI and also a rm of the sqlite files. But nothing helped.

@DonConto https://github.com/opnsense/core/commit/01d8fb296e69b99b271da0ec92caf7e1b572b953 should catch these errors.
To test, use the opnsense-patch 01d8fb2 on a console (and restart the flowd_aggregate service).

Netflow service is now stable. Thank you for your support.

@DonConto thanks for letting us know!

This worked for me too. 👍


[onebtc-sdk]: UI examples: emulate full Redeem process

[onebtc-sdk]: UI examples: emulate full Redeem process

Done


Pylint Broke after Upgrade to 1.32.3

Version: 1.32.3 (user setup)
Commit: a3db5be9b5c6ba46bb7555ec5d60178ecc2eaae4
Date: 2019-03-14T23:43:35.476Z
Electron: 3.1.6
Chrome: 66.0.3359.181
Node.js: 10.2.0
V8: 6.6.346.32
OS: Windows_NT x64 10.0.17134
Python 2.7.13
PyLint was installed and working perfectly, has been for a couple months.
I noticed a VSCode update was available recently and installed it.
Afterwards, Pylint runs (manually and automatically), but fails in Python, without even getting to the point where it processes any file parameters. Just running Pylint gives this, now:
D:\Projects\PowerShell\Python>c:\Python27\Scripts\pylint.exe
Traceback (most recent call last):
File "c:\python27\lib\runpy.py", line 174, in run_module_as_main
"main", fname, loader, pkg_name)
File "c:\python27\lib\runpy.py", line 72, in run_code
exec code in run_globals
File "c:\Python27\Scripts\pylint.exe_main.py", line 9, in
File "c:\python27\lib\site-packages\pylint_init.py", line 16, in run_pylint
Run(sys.argv[1:])
File "c:\python27\lib\site-packages\pylint\lint.py", line 1270, in init
), option_groups=self.option_groups, pylintrc=self._rcfile)
File "c:\python27\lib\site-packages\pylint\lint.py", line 466, in init
config_file=pylintrc or config.PYLINTRC)
File "c:\python27\lib\site-packages\pylint\config.py", line 464, in init
self.reset_parsers(usage, version=version)
File "c:\python27\lib\site-packages\pylint\config.py", line 478, in reset_parsers
self.cfgfile_parser = configparser.ConfigParser(inline_comment_prefixes=('#', ';'))
TypeError: init() got an unexpected keyword argument 'inline_comment_prefixes'
*** This was working fine before the update ***
Google showed others had seen this in the past, from VSCode 'futures'. A lot of noise and not a lot of solutions.
Is there a list of the files that were updated in the Python directory that I can remove to troubleshoot this?

Does this issue occur when all extensions are disabled?: Yes/No Yes

If you know that it is caused by an extension, can you tell me which one or tell me how I can figure out which one it is, so I can complain to the correct folks?


Docs for Bundle showing how to nest bundles

I've also added a clearer description of what bundles are used for, and explained that you can't query for bundles (a very common beginner confusion).

for future reference: rebasing instead of merging helps avoid pulling changes from main into the pr

bors r+


[FE] Content-Panel Manage Blog Tags

Business Requirement
As a content manager, I want to manage tags (view, add, edit, delete) for organizing blog content effectively.
(view is already implemented)
Acceptance Criteria
Implement API endpoints for:

[ ] Viewing all tags
[ ] Adding a new tag
[ ] Editing an existing tag by ID (On click on Edit the name field should become an text input and we should be able to edit the name of the tag, and we need validation to prevent the user of overwriting the tag with an empty string)
[ ] Deleting an existing tag by ID. (Display a modal to showcase the disruptive action, and to make sure the user is sure of the decision.)
[ ] Ensure validation to prevent duplicate tag names.

Since there is an existing PR with comments to be looked at: @petark7 feature/tags-with-query. I will assign this ticket to you.


Where to put documentation?

Anyone got thoughts about documentation?
There is currently:

http://adldap.sourceforge.net/wiki/doku.php?id=documentation&do=index
https://github.com/adldap/adLDAP/wiki

One goal could be to have both user documentation and auto-generated API browsing at https://adldap2.github.io. The latter could be produced by e.g. phpdoc, and the former by e.g. http://sphinx-doc.org/. Or perhaps a service like http://readthedocs.org is better?
Then, of course, comes the more meaningful task of getting the docs up to date. :) Not that they're terrible at the moment, but they do need to be consolidated.

Yea I agree :thumbsup:. I can start writing the hang written documentation, however I've actually never used an API doc generator, so any help there would be awesome.

Okay, cool.
Could you create the adldap2/adldap2.github.io repository? See https://pages.github.com/#user-site
I can get the API docs set up. I suggest a URL structure that allows each released minor version to be kept online, as well as master; something like: adldap2.github.io/api/master, adldap2.github.io/api/4.0, adldap2.github.io/api/4.1, adldap2.github.io/api/5.0, etc. Sound okay?
As for the user guide, I just noticed that phpDocumentor itself is using Sphinx, so maybe that'd be a good choice? But for now I'll just see about the API docs.... phpDocumentor is good at highlighting errors in docblocks too, so that'll help improve the codebase. :)

Done! You should have full write access to the adldap2.github.io repository.
I agree with the API structure. Also, Sami does great API documentation, using Laravel as an example, I've personally seen many more projects using Sami than I have phpDocumentor, however if it's easier to set up / use phpDocumentor, then I have no issues with it.

Thanks! I'll investigate Sami; I like the Laravel docs.
Speaking of Laravel, do you develop with it? What LDAP package do you use?
It occured to me tat we could add a list somewhere here of packages that use adLDAP, such as those for Laravel, and other frameworks and CMSs. What do you think? There's just so much fragmentation it seems! It'd be nice to bring some order to it.

@samwilson I like the style of http://readthedocs.org
Speaking of Laravel, I used ccovey/ldap-auth.
But I had to fork this package because it seems ccovey did stop maintain it and I needed Laravel 5 support.
It's a ldap authentication provider for Laravel.
Maybe we could provide a clean and tested (!) Laravel package under the adLDAP2 organisation if the most of us using Laravel.

@samwilson Yup, I develop mostly all of my packages with Laravel. I use the package I created actually called Corp, it's sort of a 'helper' package, as it merely just allows you to have a configuration file and helper methods using the facade (such as Corp::authenticate()), with some other minor functionality using Windows COM (allows you to modify LDAP passwords without SSL / TLS).
I agree with the framework and CMS list, that's a great idea!
@samwilson Offering framework packages under the Adldap2 organization would be awesome, though I could only develop for Laravel since that's where the majority of my experience lies.

(I've created #9 to track a Laravel package.)
I've not got a chance just now to look at it, but the script here seems useful for keeping a gh-pages API doc up to date: https://github.com/google/google-api-nodejs-client/issues/245

While not for API doc generation, I'd recommend taking a look at MkDocs (http://www.mkdocs.org/). Its beauty is really in its simplicity. You can generate a site from a simple 'docs/' directory structure of markdown files. The added bonus is the same doc files look good when viewed on normal Github too.

I would agree with http://readthedocs.org/ too. It is an additional "thing", but it seems fairly popular.


Do you plan to make it work with local GPU LLMs like quantized WizardLM?

That's the question, I can't use OpenAI and I would love to run this BabyAGI over the GPU in my local computer with some models like WizardLM or Gpt4-x-Vicuna, both quantized.
Do you plan to make a local version of this?
Thanks for this!

BabyAGI and Local LLMs do seem to be a good match! I'd love to support it.
I've seen an open-source project called react-llm.
https://github.com/r2d4/react-llm
I have limited knowledge about Local LLMs, but would implementing this help you achieve your goals? I would appreciate it if you could let me know.

It looks interesting, but I'm not sure how performant it could be, however in that case the GPU executing the AI would be the local GPU, if I want to share the AI with some computers in my network I'm not sure how that could work.
Out of curiositu, why not integrate it with Oobabooga as an extension?

There are gpu enabled options.
Paying "open"ai for every query is not economically feesable for non corporations.
LocalAI is a non gpu enabled option that allows for the feature to be added but cpu with llms is like playing counter strike on dialup. So don't bother with non gpu implementations.

BabyAGI and Local LLMs do seem to be a good match! I'd love to support it.
I've seen an open-source project called react-llm. https://github.com/r2d4/react-llm
I have limited knowledge about Local LLMs, but would implementing this help you achieve your goals? I would appreciate it if you could let me know.

Can we already use local LLMs in BabyAGI, or it will avaiable later, or never?


python310Packages.ansible-later: 2.0.6 -> 2.0.8

Automatic update generated by nixpkgs-update tools. This update was made based on information from passthru.updateScript.
meta.description for python310Packages.ansible-later is: "Another best practice scanner for Ansible roles and playbooks"
meta.homepage for python310Packages.ansible-later is: "https://github.com/thegeeklab/ansible-later"
meta.changelog for python310Packages.ansible-later is: ""
Updates performed

Ran passthru.UpdateScript

To inspect upstream changes

Release on GitHub

Compare changes on GitHub

Impact

Checks done (click to expand)

built on NixOS
Warning: a test defined in passthru.tests did not pass
Warning: no invocation of /nix/store/ym6qrx53crv80082b3a3ymmc39p513vw-python3.10-ansible-later-2.0.8/bin/.ansible-later-wrapped had a zero exit code or showed the expected version
Warning: no invocation of /nix/store/ym6qrx53crv80082b3a3ymmc39p513vw-python3.10-ansible-later-2.0.8/bin/ansible-later had a zero exit code or showed the expected version
0 of 2 passed binary check by having a zero exit code.
0 of 2 passed binary check by having the new version present in output.
found 2.0.8 with grep in /nix/store/ym6qrx53crv80082b3a3ymmc39p513vw-python3.10-ansible-later-2.0.8
found 2.0.8 in filename of file in /nix/store/ym6qrx53crv80082b3a3ymmc39p513vw-python3.10-ansible-later-2.0.8

Rebuild report (if merged into master) (click to expand)

4 total rebuild path(s)

2 package rebuild(s)

2 x86_64-linux rebuild(s)
2 x86_64-darwin rebuild(s)

First fifty rebuilds by attrpath
python310Packages.ansible-later
python39Packages.ansible-later

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/ym6qrx53crv80082b3a3ymmc39p513vw-python3.10-ansible-later-2.0.8 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A python310Packages.ansible-later https://github.com/r-ryantm/nixpkgs/archive/27d0d8d64b4aa5b12065ec75061666d60bb9cccd.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/ym6qrx53crv80082b3a3ymmc39p513vw-python3.10-ansible-later-2.0.8
ls -la /nix/store/ym6qrx53crv80082b3a3ymmc39p513vw-python3.10-ansible-later-2.0.8/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

2 packages built:

python310Packages.ansible-later
python39Packages.ansible-later

Maintainer pings
cc @tboerger for testing.

Result of nixpkgs-review pr 166046 run on x86_64-linux 1

2 packages built:

python310Packages.ansible-later
python39Packages.ansible-later


Bind to Unix Domain Sockets

Environment Details

Helidon Version: 2.3.2
Helidon SE or Helidon MP: Both
JDK version: 16+
OS: Linux
Docker version (if applicable): N/A

Problem Description
Permit binding to Unix Domain Sockets (via java.net.UnixDomainSocketAddress in Java 16+) to aid performance and security. This is especially useful in K8s to allow local binding within a Pod rather than exposing ports. Unfortunately that may also mean replacing the existing port (int) and binding address (InetAddress) configuration with java.net.SocketAddress.
Steps to reproduce
N/A

For reference: https://inside.java/2021/02/03/jep380-unix-domain-sockets-channels/
Note that java.net.UnixDomainSocketAddress is not supported by java.net.ServerSocket

That's a unpleasant piece undocumented piece of code!
Was there a reason why new Loom implementation used ServerSocket over NIO ServerSocketChannel in blocking mode?

Was there a reason why new Loom implementation used ServerSocket over NIO ServerSocketChannel in blocking mode?

My recollection is that it had to do with performance, but @tomas-langer would know more.

In light of JEP353 I would have thought it has a very slight performance hit over NIO.

With potential UDP support via #6731 which is using NIO DatagramChannel would this therefore require a pretty large rewrite of helidon-common-socket to accommodate plain TCP, TLS, UDP and, as future extension potentially DTLS. If this isn't a priority I may be up for having a go at this.

@dansiviter I'd like to get some feedback from the team on this. I'm putting this back on our triage list for further discussion. We have some folks out on vacation, so it might not happen immediately.

The main reasons we use ServerSocket and SSLServerSocket:

We do not need to use SSLEngine
We can use simple approach to accepting sockets and handling them
We can use byte[] instead of ByteBuffer - ByteBuffer is declared as final, which makes it a bit harder to work with, and in we want to expose to users InputStream and OutputStream which both work with byte[], also our buffer abstraction was easier to create for byte arrays

Now if we wanted to support Unix domain sockets, we would need to have a server listener implementation that uses (blocking) channels instead of sockets, that uses SSLEngine to handle TLS, and that uses ByteBuffer instead of byte[].
I think all of this is feasible, and could be probably implemented as a new class. We could switch based on configuration which listener class to instantiate in LoomServer (this would require some basic abstraction of the listener in Helidon, but all these classes are package local and are not part of public APIs, so this change could be done).
What may be complicated is the API of HTTP in Helidon, where we expect to have a host and a port (this could be worked around by using localhost:8080 as a placeholder, and some new API to check what kind of sockets we have).
I have no idea how performant this would be, as we have designed everything to be byte[] based and based on blocking ServerSocket and Socket...
If we were doing this, I would start with a prototype (e.g. a quick & dirty implementation of a server listener that shows the ideas), followed by a production implementation. We would need to be very careful to be backward compatible...


Error while hashing

Hi,
I am trying to use the app, logged in with resulting url of https://sourcerer.io/enginmanap, but one of my repositories (LimonEngine) is not listed. When I check the settings/processing I see the line:
enginmanap/limonEngine  Failed  Processing error
So I give it a go and downloaded the client, switch to master, cleared up and run the local client, but it didn't work neither. At least now I have logs to share.
I get 2 errors,
1:
[e] Hashing error: Protocol message end-group tag did not match expected tag.
2:
[e] Error while hashing: Protocol message end-group tag did not match expected tag.
I copied the log below. I removed the repeating lines, but if you need the full log I have it too.
[i] App started.
Sourcerer. Use flag --help to list available commands.
Signing in...
Signed in successfully. Your profile page is https://sourcerer.io/enginmanap
[i] Auth success.
Tracked repositories:
/home/engin/CLionProjects/limonEngine
List of your emails:
some@some — Not confirmed
some@some — Confirmed
some@some (Primary) — Confirmed
Do you want to specify additional emails that you use in repositories? [y/N]
Confirm your emails to show all statistics in profile.
[i] Hashing started.
Hashing /home/engin/CLionProjects/limonEngine repository...
[i] Hashing of repo started.
[i] Received repo from server with 0 commits.
[i] Sent 3 facts to server.
Stats computation. May take a while...
[  0.16%] * 00686c1 Update readme and status to indicate changes of 0.5
|         Extracting stats
|         No technology stats found
[i] Downloading libraries_meta.pb.
[i] Finished downloading libraries_meta.pb.
[  0.31%] * e55581a Fix exiting causes segfault.
|         Extracting stats
[i] Loading cpp.open-gl evaluator.
[i] cpp.open-gl evaluator ready.
[i] Loading cpp.sdl evaluator.
[i] cpp.sdl evaluator ready.
|         3 technology stats found
[  0.47%] * 829a5f8 Fix there is no way to quit the game without triggers
|         Extracting stats
|         4 technology stats found
[  0.62%] * de9c51c Add imports that was hidden by Cotire
|         Extracting stats
|         3 technology stats found
[  0.78%] * abdde7c Fix army pilot textures are all purple.
|         Extracting stats
|         2 technology stats found
.
. removed to make the log smaller
.
[  3.12%] * 7131975 Fix compile fails with gcc 8.2
|         Extracting stats
|         1 technology stats found
[  3.27%] * b976d44 Fix world loading fails is custom quit world is empty
|         Extracting stats
|         1 technology stats found
[  3.43%] * aba686d upgrade ImGui to version 1.62
|         Extracting stats
[i] Loading cpp.imgui evaluator.
[e] Hashing error: Protocol message end-group tag did not match expected tag.
[  3.58%] * 162255d Upgrade Cotire to version 1.8
[  3.74%] * 30f92fb Add new trigger Return to previous world.
[  3.89%] * 25df5c6 Add error messages to world verification
.
. removed to make the log smaller
.
[ 99.53%] * 7f01aa0 extract model data buffering from GLHelper constructor
[ 99.69%] * 26fe097 switch to the star model
[ 99.84%] * 91e7e23 simplify draw code.
[100.00%] * 46372b3 Initial commit for uber game.
[i] Sent 67 facts to server.
[e] Error while hashing: Protocol message end-group tag did not match expected tag.
The repositories have been hashed.
Take a look at the updates in your profile at https://sourcerer.io/enginmanap
[i] Hashing success.
You could use console commands to control repositories.
For more info run application with flag --help.
Feel free to contact us on any problem by<EMAIL_ADDRESS>[i] App finished.

This is fixed, many thanks.


[RFC] Steps toward OpenBSD support

Hey all. Experienced Python programmer and beginner Rustacean here. Never heard that one before, right. Anyway, I'm super glad this project exists!
Summary
I'm on OpenBSD and am having trouble building the RustPython Virtual Machine due to (completely reasonable) assumptions about the universal nature of *nix system flags that OpenBSD does not implement or implements differently.
Detailed Explanation
The following are the variables I found that were undefined:
Errors

ENODATA: Used once in Lib/shutil.py in a conditional statement that is never reached because OpenBSD does not support extended attributes.
EMULTIHOP ENOLINK ENOSTR ENOSR ETIME: Unused in RustPython and CPython.

These errors are all defined in errno.rs. This file includes a lot of provisions about operating systems but assumes that all the error codes it imports from libc and then looks for are defined. CPython's implementation of the same idea has a much more exhaustive list of error codes, but each is surrounded by #ifdef/#endif preprocessor tags, avoiding lots of errors. Unfortunately, I do not believe there's an equivalent in Rust for this, but there's gotta be a fairly painless solution out there.
Socket constants

AI_ALL: The compiler expects libc to define this, but OpenBSD doesn't implement it.
AI_PASSIVE: OpenBSD does implement this one, but libc does not define it.

As far as I can tell, in fact, none of the constants for addrinfo's ai_flags are defined by libc for OpenBSD. This might be a problem with libc, but I'm not well-versed enough in the way that repository works to come to any conclusion without conjecture.
Functions

getgroups: Required once in os.rs. I found that nix::unistd defined this function, just like on linux and android, so I added a target_os = "openbsd" and that seemed to fix it. Perhaps other *nixes also have this problem? Might be worth looking into.
os_umask: Also required once by os.rs. Fixed in a similar fashion to getgroups.

Miscellaneous system stuff

getresuid getresgid: Yet more things that it appears libc should be providing for us but aren't. setresuid and setresgid are indeed provided by libc, but not the gets for some reason.
getregid: It doesn't seem like libc provides this one either.
SIGPWR SIGSTKFLT: Signals for power cut and stack fault, respectively. Both unused by OpenBSD. I added another target_os = "openbsd" to the cfg surrounding their occurrences. Other operating systems might have similar problems and may need to be added to this cfg.

MetadataExt

A lot of functions were missing from os.rs due to its inability to find the MetadataExt trait. I just found the appropriate line and added the relevant OpenBSD use.

Fixing this caused another issue: ModeT was not defined. I added a definition here

Conclusion
I added whatever support I could. I'm not that great at Rust; neither am I that great at *nix. But I did manage to cull down the errors from 24 to 5 in a couple of hours. I'm definitely willing to contribute to OpenBSD support in the future, assuming you folks are willing to help me out wherever my knowledge is lacking.
My personal branch for those who want to see the end results of my finagling. This should get you far less errors compiling for OpenBSD.

CPython's implementation of the same idea has a much more exhaustive list of error codes, but each is surrounded by #ifdef/#endif preprocessor tags, avoiding lots of errors. Unfortunately, I do not believe there's an equivalent in Rust for this, but there's gotta be a fairly painless solution out there.

Rust does have an (arguably nicer) equivalent: conditional compilation based on flags (see here), so I think this would be pretty portable.

If I understand correctly, what you mean by ifdef is checking if a specific error constant is defined, and then adding it to the module if it is. Rust does not have something like that currently, though there's a #[cfg(accessible)] directive in development that I'm following closely due to this exact use case.

Thanks for your responses! @coolreader18 has it right about what I'm looking for. In C, you can conditionally compile based on the existence of a constant. I do know about Rust's conditional compilation using cfg, but it lacks this feature.
The closest we have to this for now is singling out the problems for each individual case and using the extant conditional compiling flags. I made that work on my branch, but it's messy.
If we could just add the #[cfg(accessible)] to the macro e in errno.rs, it would be much cleaner.
Anyway, here's my branch's version of errno.rs. It excludes the problem codes for compilation on OpenBSD. As far as I can tell, this is the best situation open to us at the moment.

Just opened #1946. It's still being approved by CI. Thanks for your help!


Build failure: rPackages.V8

Steps To Reproduce
Steps to reproduce the behavior:

Be on unstable
nix build nixpkgs#rPackages.V8
If the version is 5.0.0, then it won't build.

Build log
Running phase: unpackPhase
@nix { "action": "setPhase", "phase": "unpackPhase" }
unpacking source archive /nix/store/92nvrcn6w8k2ylbrjzmd3lalwri0c4mv-V8_5.0.0.tar.gz
source root is V8
setting SOURCE_DATE_EPOCH to timestamp<PHONE_NUMBER> of file V8/MD5
Running phase: patchPhase
@nix { "action": "setPhase", "phase": "patchPhase" }
Running phase: updateAutotoolsGnuConfigScriptsPhase
@nix { "action": "setPhase", "phase": "updateAutotoolsGnuConfigScriptsPhase" }
Running phase: configurePhase
@nix { "action": "setPhase", "phase": "configurePhase" }
patching script interpreter paths in configure
Running phase: buildPhase
@nix { "action": "setPhase", "phase": "buildPhase" }
Running phase: checkPhase
@nix { "action": "setPhase", "phase": "checkPhase" }
Running phase: installPhase
@nix { "action": "setPhase", "phase": "installPhase" }
* installing *source* package 'V8' ...
file 'configure' has the wrong MD5 checksum
** using staged installation
Found C++20 compiler: /nix/store/gxpdysvlj9l6bfin03k6yq0s922pk7pg-gcc-wrapper-13.3.0/bin/c++
Found INCLUDE_DIR and/or LIB_DIR!
Using CXXCPP=/nix/store/gxpdysvlj9l6bfin03k6yq0s922pk7pg-gcc-wrapper-13.3.0/bin/c++ -std=gnu++20 -E
Using PKG_CFLAGS=-I/nix/store/sl8zwksqc08asblhr5r36dlhzy6brmpk-nodejs-20.16.0-libv8/include -I/usr/include/v8
Using PKG_LIBS=-L/nix/store/sl8zwksqc08asblhr5r36dlhzy6brmpk-nodejs-20.16.0-libv8/lib -lv8
Running feature test for pointer compression...
/nix/store/d828ccvc2148g7m49hh3mzvyzwpipy46-binutils-2.42/bin/ld: /build/cci07brP.o: in function `main':
/build/V8/tools/test.cpp:7:(.text.startup+0x36): undefined reference to `v8::platform::NewDefaultPlatform(int, v8::platform::IdleTaskSupport, v8::platform::InProcessStackDumping, std::unique_ptr<v8::TracingController, std::default_delete<v8::TracingController> >)'
/nix/store/d828ccvc2148g7m49hh3mzvyzwpipy46-binutils-2.42/bin/ld: /build/V8/tools/test.cpp:8:(.text.startup+0x48): undefined reference to `v8::V8::InitializePlatform(v8::Platform*)'
/nix/store/d828ccvc2148g7m49hh3mzvyzwpipy46-binutils-2.42/bin/ld: /build/cci07brP.o: in function `v8::V8::Initialize()':
/nix/store/sl8zwksqc08asblhr5r36dlhzy6brmpk-nodejs-20.16.0-libv8/include/v8-initialization.h:104:(.text.startup+0x4f): undefined reference to `v8::V8::Initialize(int)'
collect2: error: ld returned 1 exit status
Pointer compression not needed
/nix/store/d828ccvc2148g7m49hh3mzvyzwpipy46-binutils-2.42/bin/ld: /build/ccvxSXdC.o: in function `main':
/build/V8/tools/version.cpp:5:(.text.startup+0x2): undefined reference to `v8::V8::GetVersion()'
collect2: error: ld returned 1 exit status
./configure: line 154: ./v8version: not found
** libs
using C++ compiler: 'g++ (GCC) 13.3.0'
using C++20
rm -f V8.so RcppExports.o bindings.o
/nix/store/gxpdysvlj9l6bfin03k6yq0s922pk7pg-gcc-wrapper-13.3.0/bin/c++ -std=gnu++20 -I"/nix/store/fnl3bp7k0qw8cayqz2lciq8sq0xmib2c-R-4.4.1/lib/R/include" -DNDEBUG -I/nix/store/sl8zwksqc08asblhr5r36dlhzy6brmpk-nodejs-20.16.0-libv8/include -I/usr/include/v8 -DV8_ENABLE_CHECKS -I'/nix/store/sx72hmip9xs97vqw2dsjm67n63sc17f0-r-Rcpp-1.0.13/library/Rcpp/include'    -fvisibility=hidden -fpic  -g -O2   -c RcppExports.cpp -o RcppExports.o
/nix/store/gxpdysvlj9l6bfin03k6yq0s922pk7pg-gcc-wrapper-13.3.0/bin/c++ -std=gnu++20 -I"/nix/store/fnl3bp7k0qw8cayqz2lciq8sq0xmib2c-R-4.4.1/lib/R/include" -DNDEBUG -I/nix/store/sl8zwksqc08asblhr5r36dlhzy6brmpk-nodejs-20.16.0-libv8/include -I/usr/include/v8 -DV8_ENABLE_CHECKS -I'/nix/store/sx72hmip9xs97vqw2dsjm67n63sc17f0-r-Rcpp-1.0.13/library/Rcpp/include'    -fvisibility=hidden -fpic  -g -O2   -c bindings.cpp -o bindings.o
/nix/store/gxpdysvlj9l6bfin03k6yq0s922pk7pg-gcc-wrapper-13.3.0/bin/c++ -std=gnu++20 -shared -L/nix/store/fnl3bp7k0qw8cayqz2lciq8sq0xmib2c-R-4.4.1/lib/R/lib -o V8.so RcppExports.o bindings.o -L/nix/store/sl8zwksqc08asblhr5r36dlhzy6brmpk-nodejs-20.16.0-libv8/lib -lv8 -L/nix/store/fnl3bp7k0qw8cayqz2lciq8sq0xmib2c-R-4.4.1/lib/R/lib -lR
installing to /nix/store/xry9hlna4xhk4zn7s91rx02gbh3ip9ym-r-V8-5.0.0/library/00LOCK-V8/00new/V8/libs
** R
** inst
** byte-compile and prepare package for lazy loading
** help
*** installing help indices
** building package indices
** installing vignettes
** testing if installed package can be loaded from temporary location
Error: package or namespace load failed for 'V8' in dyn.load(file, DLLpath = DLLpath, ...):
 unable to load shared object '/nix/store/xry9hlna4xhk4zn7s91rx02gbh3ip9ym-r-V8-5.0.0/library/00LOCK-V8/00new/V8/libs/V8.so':
  /nix/store/xry9hlna4xhk4zn7s91rx02gbh3ip9ym-r-V8-5.0.0/library/00LOCK-V8/00new/V8/libs/V8.so: undefined symbol: _ZN2v815ArrayBufferView9CheckCastEPNS_5ValueE
Error: loading failed
Execution halted
ERROR: loading failed
* removing '/nix/store/xry9hlna4xhk4zn7s91rx02gbh3ip9ym-r-V8-5.0.0/library/V8'

Additional context
Add any other context about the problem here.
Notify maintainers
@jbedo I think you'd be the right person to ping about this.

Metadata
Please run nix-shell -p nix-info --run "nix-info -m" and paste the result.
[user@system:~]$ nix-shell -p nix-info --run "nix-info -m"
 - system: `"x86_64-linux"`
 - host os: `Linux <IP_ADDRESS>-microsoft-standard-WSL2, NixOS, 24.11 (Vicuna), 24.11.20240903.2830c7c`
 - multi-user?: `yes`
 - sandbox: `yes`
 - version: `nix-env (Nix) 2.18.5`
 - nixpkgs: `/nix/store/3k5a074975asfpx63n29agzskx822gp5-source`

Add a :+1: reaction to issues you find important.

This is an issue with the libv8 build, the library is empty:
❯ nm /nix/store/sl8zwksqc08asblhr5r36dlhzy6brmpk-nodejs-20.16.0-libv8/lib/libv8.a

❯ stat /nix/store/sl8zwksqc08asblhr5r36dlhzy6brmpk-nodejs-20.16.0-libv8/lib/libv8.a
  File: /nix/store/sl8zwksqc08asblhr5r36dlhzy6brmpk-nodejs-20.16.0-libv8/lib/libv8.a
  Size: 8               Blocks: 1          IO Block: 512    regular file
Device: 259,2   Inode: 273319414   Links: 1
Access: (0444/-r--r--r--)  Uid: (    0/    root)   Gid: (    0/    root)
Access: 2024-09-06 08:36:02.609609321 +1000
Modify: 1970-01-01 10:00:01.000000000 +1000
Change: 2024-09-02 10:23:27.078380614 +1000
 Birth: 2024-09-02 10:23:27.077380599 +1000

❯ cat !$
cat /nix/store/sl8zwksqc08asblhr5r36dlhzy6brmpk-nodejs-20.16.0-libv8/lib/libv8.a
!<arch>

❯

Ping @aduh95.

I suspect this was solved by https://github.com/NixOS/nixpkgs/pull/337360.

@savyajha https://github.com/NixOS/nixpkgs/pull/337360 has landed on staging, not master. Can you try to cherry-pick https://github.com/NixOS/nixpkgs/commit/efbf70d52cbd6038d3476fcc2a6358ba5f57d5d9 on top of master and re-try to build?

@aduh95 Yup, I should have been more careful, I assumed it had landed on master. It builds with that specific patch. Cheers.

Are there any estimates on when this can be expected to be solved? As of today, it still does not build

When https://github.com/NixOS/nixpkgs/pull/343421 is merged


H264 Start Code Processing Skips some start codes.

After further investigation, it seems I have found another issue with the start code processing and its handling of 3 byte start codes. consider the following set of bytes:
ptr[0]	0x69 'i'
ptr[1]	0x37 '7'
ptr[2]	0xf9 'ù'
ptr[3]	0x4b 'K'
ptr[4]	0xe7 'ç'
ptr[5]	0x81 '�'
ptr[6]	0x00 '\0'
ptr[7]	0x00 '\0'
ptr[8]	0x01 '\x1'

The find_h26x_start_code located:
https://github.com/ultravideo/uvgRTP/blob/b9de6ad8c27e8ec015eaeea7f156569c30fb2a2a/src/formats/h26x.cc#L291
offset = find_h26x_start_code(data, data_len, offset, start_len);
The function misses processing the start code in the above situation. This is due to the technique used for finding zero's and it's 4 byte alignment. After debugging the code manually, I can see the 64bit scanning detecting the potential bytes and throttling into the 32bit comparison check. However, the 4 byte aligned processing for determining start code scenarios is unable to see it and moves along because the start code rides on the boundary. When compared to FFMPEG's processing, I have verified that FFMPEG is able to detect this scenario and divide the NALU appropriately.
I do not currently have an elegant solution to this issue that will maintain the same performance.

@jhkimura Thanks!


ES{6,7} support.

Time to add some babel support and use es6 features wherever we can?
//cc @addyosmani @SBoudrias @sindresorhus @passy

:-1: not everybody likes ecmascript personally i prefer javascript as well

:+1:! Will submit a PR if everybody agrees ;)

+1 Can be optional!

@arthurvr if you want to move forward on this, we should take care of this before anything else: https://github.com/yeoman/generator-node/issues/66

Closing as this was merged into the node.next branch.


Fix retention

Stop retain when db has no more data.

Codecov Report
Attention: 5 lines in your changes are missing coverage. Please review.

Comparison is base (a59ac5a) 46.20% compared to head (dca5eca) 46.17%.

Files
Patch %
Lines

src/storage.rs
0.00%
5 Missing :warning:

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.
Additional details and impacted files
@@            Coverage Diff             @@
##             main     #622      +/-   ##
==========================================
- Coverage   46.20%   46.17%   -0.03%
==========================================
  Files          26       26
  Lines        6824     6828       +4
==========================================
  Hits         3153     3153
- Misses       3671     3675       +4

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Stack trace line numbers on OSX

Thanks for the awesome library.
Would you be interested in adding line numbers to the stack trace on OSX (if debug symbols are present)? There's some code for doing this (using the atos utility) here:

http://stackoverflow.com/questions/8278691/how-to-fix-backtrace-line-number-error-in-c (2nd answer)
http://cvs.tekkotsu.org/viewvc/Tekkotsu/Shared/StackTrace.cc?view=markup

On Linux, addr2line could be used.

This is a good suggestion, and piping atos shouldn't be too much work. I'm not sure when I'll find the time to do this, however.


getting error when runing rquirement install

% pip3 install -r requirement.txt
DEPRECATION: Configuring installation scheme with distutils config files is deprecated and will no longer work in the near future. If you are using a Homebrew or Linuxbrew Python, please see discussion at https://github.com/Homebrew/homebrew-core/issues/76621
ERROR: Invalid requirement: "GET /performapi/api/SystemLookup?$filter=ColumnCode%20gt%20' HTTP/1.1" (from line 1 of req.txt)
Hint: It looks like a path. File 'GET /performapi/api/SystemLookup?$filter=ColumnCode%20gt%20' HTTP/1.1' does not exist.
WARNING: There was an error checking the latest version of pip.

I think there is a problem with your device, i mean the python.
from the error message above:
WARNING: There was an error checking the latest version of pip.
try upgrading your pip3 using this command
python3 -m pip install --upgrade pip.

maybe someone can give another solution than what i told?


Adding back try/catch inadvertently removed from CIDR code

This try/catch was inadvertently removed as part of the wildcard matching PR (#18). The effect of this is certain strings that fail to be parsed as CIDR will bubble-up an exception instead of being treated as an exact match. Reverting to be like before.

Is it worth adding a unit test that confirms the behaviour?


Use npx

Hey, it would be great to support npx gql-gen. This way you don't have to install it globally (or locally) for a single shot.
Great job :+1:

Just my two cents. With Yarn, you already have this feature included by default ... yarn gql-gen ;) I understand, it's not always viable to use Yarn, but this is not very well known feature imo.

Just tested the latest version of the codegen with the latest version of npx and it works :)
@FredyC got a good point, Yarn has a built-in npx ;)


CURL example for sending attachment not working on PHP 5.6+

'files['.$fileName.']' =><EMAIL_ADDRESS>are no longer supported in PHP 5.6 and up. It takes me some times to figure out the problem. Maybe you can include the example that using CURLFile for those who use PHP 5.6+.
Here are some example:
https://stackoverflow.com/questions/25934128/curl-file-uploads-not-working-anymore-after-upgrade-from-php-5-5-to-5-6
http://barrycarlyon.co.uk/wordpress/2015/10/04/php5-6-curl-and-file-uploads/
And here is the docs page:
https://sendgrid.com/docs/Integrate/Code_Examples/v2_Mail/php.html

Hello @luqmansungkar,Thanks for your suggestion or question! In an attempt to clear out our backlog,                                              we are closing out issues over 90 days old.                                             If this is still an issue, please feel free to reopen it.                                             Team SendGrid DX-Docs


Clarify some of the wording; fix some grammar

Clarify wording; fix grammar

Sorry, I didn't notice this PR. Applied manually. Thank you!


Remote: ggvis plotting crashes the interactive R session

Running this sequence of commands on the remote machine. Note that ggvis plotting generates HTML that must be brokered back to the client machine.
> library(ggvis)
> mtcars %>%
+     ggvis( ~ wt, ~ mpg) %>%
+     layer_points() %>%
+     layer_smooths()
R Host process is stopped. Click Reset to start a new one.Interactive Window is disconnected from R Session.
Open Workspaces window and either select local R interpreter or try connecting to a remote machine.
>

Please try updated 0.5 - I believe this is a stack size issue. Reactivate if still reproes.


Decorated graphs

This PR, which addresses #36, adds functionality for decorating graphs by adding additional graphs on their edges or vertices.
Two functions are provided
decorate_graph_edges(g::NamedGraph; edge_map::Function=e -> named_grid((1,)))
and
decorate_graph_vertices(g::NamedGraph; vertex_map::Function=v -> named_grid((1,)))
Currently there are defaults for which vertices of the decoration are connected to the edges/vertices original graph but we will add keyword arguments for this in the future.
Testing is included. This PR also fixed an ambiguity issue with function a_star when passed a NamedGraph with Integer labelling.

Codecov Report

Merging #37 (c59c428) into main (2a0217b) will increase coverage by 0.40%.
The diff coverage is 93.33%.

:exclamation: Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the Github App Integration for your organization. Read more.
@@            Coverage Diff             @@
##             main      #37      +/-   ##
==========================================
+ Coverage   80.29%   80.70%   +0.40%
==========================================
  Files          20       21       +1
  Lines         878      907      +29
==========================================
+ Hits          705      732      +27
- Misses        173      175       +2

Impacted Files
Coverage Δ

src/NamedGraphs.jl
100.00% <ø> (ø)

src/abstractnamedgraph.jl
83.08% <66.66%> (-0.51%)
:arrow_down:

src/Graphs/generators/decoratedgraphs.jl
100.00% <100.00%> (ø)

For the current version of vertex_map, aren't the edges connecting to the decorated vertex essentially random since the ordering that neighbors outputs is an internal detail? Seems like until we decide how to specify those new edges, it's not so useful.

Maybe vertex_map could be a function that accepts a list of vertices, where the first one is the vertex and the rest are the neighbors of that vertex. Then the user is expected to add edges between their new vertices in the vertex decoration and the neighbor vertices. If those aren't added, then those edges could be added (essentially) randomly as you do it now.

For the current version of vertex_map, aren't the edges connecting to the decorated vertex essentially random since the ordering that neighbors outputs is an internal detail? Seems like until we decide how to specify those new edges, it's not so useful.

Currently the vertex vd which is being decorated is removed and replaced with the decoration graph gd. The edges which originally connected vd to its neighbors in the undecorated graph vd_neighbors are reconnected to the first vertex of gd? So there is nothing random going on but obviously ideally the user should decide which vertices of gd should connect up to which members of vd_neighbors ?

Oh I see, I was picturing that each vertex neighbor would get connected to unique vertices of the decorated graph getting inserted onto the vertex, that's why I thought it would be random to some extent. In that case, I agree it isn't random since the user can choose which is the first vertex of the decorated vertex graph. In that case it seems fine to leave it for future work to give more control to the users over how the edges to the neighbors get specified.


Add consumergroup member count metric

Accidentally sorted the imports, hopefully that won't be an issue.
Closes: #18

Hey,
thanks for the PR. Currently I am short on time, so it may take a while until I reviewed and tested the proposed changes.

Sure take your time :+1:

Change LGTM, but the processGroupMetadata method does not handle tombstones yet. Accordingly you'll always store the groupMetadata as we receive it, but we never delete it.
This requires further attention and I am not entirely sure how tombstones are supposed to be handled there without investigating that on my own.

I don't fully understand tombstones thing yet, but I vaguely understood it looking at processOffsetCommit's handling of tombstones.
If it can be done in the same way for processGroupMetadata as well I can implement it.
If not, I can wait for someone more knowledgeable to implement tombstone handling in processGroupMetadata before this gets merged.

subscribed - would like this metric as well

are there any plans to merge this PR?

This PR is incomplete because it doesn't handle tombstones and therefore introduces a potential memory leak. In general I'd like to add that I intend to rewrite Kafka Minion in .NET Core and I will potentially to add features like this during the rewrite.
Thus I believe it's appropriate to close the PR, thank you for the contribution and effort though!


Adding code generation utilities used on the loading side of things

There is likely more to add here when we get to the beans and such.

Looks like Appveyor is failing at git lfs.

@cschroed-usgs let me know if that makes enough sense for future developer dude.

:+1:


Fixed Issue #300

If both the color1 and color2 are null the equals used to return false.
Now it returns true

Hi, thanks for the PR.  Can you please open it on https://github.com/bgrins/TinyColor/?

Actually the more I think about it I wonder if this should be done outside of tinycolor.equals.  I don't think tinycolor.equals(false, null) should really be true, for instance.  So maybe we should be handling this with a separate helper function in spectrum called colorsEqual or something that does the additional check before calling into tinycolor.equals

You have a point that false and null shouldn't be equal colors. Although it is a matter of perspective.. We can think that everything that's not a color is actually the same thing.
It might make sense to use a strict equality in case of !color1 && !color2
The real problem related to spectrum is that an onchange event is triggered when there is no change (the old and the new values are null)
I've opened this issue in the TinyColor - https://github.com/bgrins/TinyColor/issues/121


Support for categories on archive + Misc

Add support for category list on archive
BMAC support
Support for plugins

Completed with v1.0.3


Internet Explorer prod build broken at runtime by 8.3.20 upgrade

🐞 Bug report
Command (mark with an x)

[ ] new
[x] build
[ ] serve
[ ] test
[ ] e2e
[ ] generate
[ ] add
[ ] update
[ ] lint
[ ] xi18n
[ ] run
[ ] config
[ ] help
[ ] version
[ ] doc

Is this a regression?
Yes, the previous version in which this bug was not present was: 8.3.19
Description
Production build is completely fine when compiled with 8.3.19 and is working on Internet Explorer. Upgrading to 8.3.20 (and devkit/build-angular to 0.803.20 accordingly) is breaking the runtime execution of the app. No other project change besides this 19-to-20 change.
🔬 Minimal Reproduction
The problem is NOT present when I use ng serve nor it is with ng serve --prod (assuming here the target is es5). I could only get the error when the final prod build is deployed on a web server (with differential loading active). The error stacktrace is consequently lost in the minified JS and doesn't say much about the problem location.
🔥 Exception or Error

Object doesn't support property or method 'some'

According to MDN, Arrays.some is supported by Internet Explorer since version 9. I searched my entire code for calls to any some method and could not find a single one.
🌍 Your Environment

Angular CLI: 8.3.20
Node: 12.13.1
OS: win32 x64
Angular: 8.2.14
... animations, common, compiler, compiler-cli, core, forms
... language-service, platform-browser, platform-browser-dynamic
... router

Package                            Version
------------------------------------------------------------
@angular-devkit/architect          0.803.20
@angular-devkit/build-angular      0.803.20
@angular-devkit/build-optimizer    0.803.20
@angular-devkit/build-webpack      0.803.20
@angular-devkit/core               8.3.20
@angular-devkit/schematics         8.3.20
@angular/cdk                       8.2.3
@angular/cli                       8.3.20
@angular/material                  8.2.3
@angular/material-moment-adapter   8.2.3
@ngtools/webpack                   8.3.20
@schematics/angular                8.3.20
@schematics/update                 0.803.20
rxjs                               6.5.3
typescript                         3.5.3
webpack                            4.39.2

Anything else relevant?
IE11
Browserslist :

> 0.5%
last 2 versions
Firefox ESR
not dead
IE 9-11 # For IE 9-11 support, remove 'not'.

Compiler options for ng build --prod :
module : exnext
target: es2015

Duplicate of #16366


[Agreements] Add back Microsoft.PowerBI.DesktopReportServer

@denelon @stephengillie
Microsoft Reviewers: Open in CodeFlow

This manifest contains a term that is blocked:

Trenly wants to merge 1 commit into microsoft:master from Trenly:ReportServerEULA    Custom: ACCEPT_EULA=1   - AgreementLabel: End User License Agreement (EULA)

(Automated response - build 763.)


Bug: Trashcan Emoji Does Not Timeout for Several Commands

I noticed the other day that several of ClemBot's commands appear to have no trashcan emoji timeout, meaning that anytime in the future the command query author can click the trashcan for ClemBot to delete the message. Specifically, I noticed that an !info command message I had sent half a day before still had the trashcan, and when pressed still deleted the message.
If I understand correctly, this also means that ClemBot is basically creating and storing an ever-growing list of messages in the self.messages array of delete_message_service.py until the bot crashes or restarts.
Commands confirmed to have the issue

info

Commands suspected to have the issue

source list (source <file-name> works just fine)
tags
help
define (but not define error messages)
grades (specifically grades <course-ID> haven't checked others)
convert / bconvert error messages
prof list
roles
ClemBot error messages (e.g. command not found)

Commands that do not have the issue

slots
ogslots
translate
define error messages
convert / bconvert
source print

Anything not listed hasn't been checked by me.
By suspected, I mean that I haven't tried pressing the trashcan on the output from one of these commands to confirm ClemBot will still delete the message.
Example

The info command doesn't have a set timeout, it will last for as long as the bot hasn't restarted, adding a timeout is trivial if we want to do that

Could I be added to this issue? And clarifying question, would you prefer adding a default timeout value or adding a timeout value to each of the services which do not have it?


New dashboard item: Share of renewable energy in households

This commit only contains translations and javascript
Create the constraint (i.e. dashboard item) with:INSERT INTO `constraints` (`id`,`key`,`created_at`,`updated_at`,`gquery_key`,`group`,`position`,`disabled`,`output_element_id`)
VALUES (18,'renewable_percentage_households',NOW(),NOW(),'dashboard_renewability_households','renewable',NULL,0,49);

Also merge quintel/etsource#1200

Closes #2299

I adjusted the constraint title a little ("Renewables households" → "Households renewables")

:+1:

Can a migration be added to do this? There is an example, here.

Of course it can (thx for the example). I did not do it because Dennis told me to do it manually - probably for me to learn about our databases. Or was there a specific reason why this should not be done with a migration, @dennisschoenmakers?

Or was there a specific reason why this should not be done with a migration, @dennisschoenmakers?

When we deploy to production we often just copy database tables for semi-static data like constraints, so migrations aren't really needed. I still think they're useful for beta/staging and our local copies of the app (especially since raw SQL may depend in IDs which are different on the staging DB than your local copy).


PromQL: Adds tests for delta with histograms

Part of #13934 .
This PR adds tests to verify the behaviour of delta function with histograms.
CC: @beorn7

Updated the PR with suggestions!

Ignoring the failed MS Windows test. I don't even see the test failure in the output.


Pishrink doesn't shrink BookWorm image file

I wanted to shrink a bookworm 64bits image which is on a USB key (µSD). Using Pishrink under Bookworm or Buster OS result is the same.
Here is the result :
`phil@PhilBox64:/media/phil/9286-4DB0 $ sudo pishrink.sh -d philbox.img
pishrink.sh: Creating log file /media/phil/9286-4DB0/pishrink.log
PiShrink v24.10.23 - https://github.com/Drewsif/PiShrink
pishrink.sh: Gathering data
pishrink.sh: Checking filesystem
rootfs: 281729/942080 files (0.2% non-contiguous), 3359370/3757440 blocks
resize2fs 1.47.0 (5-Feb-2023)
pishrink.sh: Filesystem already shrunk to smallest size. Skipping filesystem shrinking
pishrink.sh: Shrunk toto.img from 15G to 15G
`
Here is the pishrink.log :
`PiShrink v24.10.23 - https://github.com/Drewsif/PiShrink
pishrink.sh: Gathering data
Line 326
beforesize: 15G
parted_output: BYT;
/media/pi/3C700FBE700F7E40/philbox.img:15931539456B:file:512:512:msdos::;
1:5242880B:407896063B:402653184B:fat32::lba;
2:413138944B:15803613183B:15390474240B:ext4::;
partnum: 2
partstart: 413138944
parttype: primary
tune2fs_output: tune2fs 1.44.5 (15-Dec-2018)
Filesystem volume name:   rootfs
Last mounted on:          /
Filesystem UUID:          803b81d5-c5d1-45d4-b0bf-3adef6d7e66d
Filesystem magic number:  0xEF53
Filesystem revision #:    1 (dynamic)
Filesystem features:      has_journal ext_attr resize_inode dir_index filetype needs_recovery extent flex_bg sparse_super large_file dir_nlink extra_isize metadata_csum
Filesystem flags:         unsigned_directory_hash
Default mount options:    user_xattr acl
Filesystem state:         clean
Errors behavior:          Continue
Filesystem OS type:       Linux
Inode count:              942080
Block count:              3757440
Reserved block count:     187871
Free blocks:              368899
Free inodes:              660086
First block:              0
Block size:               4096
Fragment size:            4096
Reserved GDT blocks:      878
Blocks per group:         32768
Fragments per group:      32768
Inodes per group:         8192
Inode blocks per group:   512
Flex block group size:    16
Filesystem created:       Tue Oct 22 15:28:19 2024
Last mount time:          Tue Nov 19 18:17:01 2024
Last write time:          Sun Nov 24 17:51:08 2024
Mount count:              28
Maximum mount count:      -1
Last checked:             Tue Oct 22 15:28:19 2024
Check interval:           0 ()
Lifetime writes:          20 GB
Reserved blocks uid:      0 (user root)
Reserved blocks gid:      0 (group root)
First inode:              11
Inode size:	          256
Required extra isize:     32
Desired extra isize:      32
Journal inode:            8
Default directory hash:   half_md4
Directory Hash Seed:      a71d4884-b13f-463f-bb3a-1e3c3586b3ee
Journal backup:           inode blocks
Checksum type:            crc32c
Checksum:                 0x5b90a781
currentsize: 3757440
blocksize: 4096
Creating new /etc/rc.local
pishrink.sh: Checking filesystem
rootfs: 281997/942080 files (0.2% non-contiguous), 3388544/3757440 blocks
resize2fs 1.44.5 (15-Dec-2018)
Line 346
currentsize: 3757440
minsize: 3757440
pishrink.sh: Filesystem already shrunk to smallest size. Skipping filesystem shrinking
Line 453
aftersize: 15G
pishrink.sh: Shrunk philbox.img from 15G to 15G
`
What is wrong ?

This is because resize2fs can not shrink the filesystem anymore than it already is and there is nothing more we can do. I've seen this before and I'm not 100% sure why as there is generally free disk space but it is out of my hands.
You can try messing with resize2fs to see if there is some option combination to get it working but check the free space and make sure you are not using most/all of the 15G. If you find something do let me know and sorry I could not have an answer to fix it.


Conda Virtual Environments?

Will there be Conda Virtual Environment support eventually?

I'm not familiar with conda virtual environments.  What's involved in supporting a conda virtual environment?

We are also interested in this.  I'm getting some interesting errors when attempting chalice deploy.
anaconda docs
anaconda download

╰─$ chalice deploy
Initial creation of lambda function.
Updating IAM policy.
Creating deployment package.
Traceback (most recent call last):
  File "//anaconda/bin/chalice", line 11, in <module>
    sys.exit(main())
  File "//anaconda/lib/python2.7/site-packages/chalice/cli/__init__.py", line 348, in main
    return cli(obj={})
  File "//anaconda/lib/python2.7/site-packages/click/core.py", line 716, in __call__
    return self.main(*args, **kwargs)
  File "//anaconda/lib/python2.7/site-packages/click/core.py", line 696, in main
    rv = self.invoke(ctx)
  File "//anaconda/lib/python2.7/site-packages/click/core.py", line 1060, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "//anaconda/lib/python2.7/site-packages/click/core.py", line 889, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "//anaconda/lib/python2.7/site-packages/click/core.py", line 534, in invoke
    return callback(*args, **kwargs)
  File "//anaconda/lib/python2.7/site-packages/click/decorators.py", line 17, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "//anaconda/lib/python2.7/site-packages/chalice/cli/__init__.py", line 207, in deploy
    d.deploy(config)
  File "//anaconda/lib/python2.7/site-packages/chalice/deployer.py", line 271, in deploy
    self._lambda_deploy.deploy(config)
  File "//anaconda/lib/python2.7/site-packages/chalice/deployer.py", line 567, in deploy
    function_arn = self._first_time_lambda_create(config)
  File "//anaconda/lib/python2.7/site-packages/chalice/deployer.py", line 655, in _first_time_lambda_create
    config.project_dir)
  File "//anaconda/lib/python2.7/site-packages/chalice/deployer.py", line 403, in create_deployment_package
    self._create_virtualenv(venv_dir)
  File "//anaconda/lib/python2.7/site-packages/chalice/deployer.py", line 392, in _create_virtualenv
    virtualenv.main()
  File "//anaconda/lib/python2.7/site-packages/virtualenv.py", line 713, in main
    symlink=options.symlink)
  File "//anaconda/lib/python2.7/site-packages/virtualenv.py", line 945, in create_environment
    download=download,
  File "//anaconda/lib/python2.7/site-packages/virtualenv.py", line 901, in install_wheel
    call_subprocess(cmd, show_stdout=False, extra_env=env, stdin=SCRIPT)
  File "//anaconda/lib/python2.7/site-packages/virtualenv.py", line 797, in call_subprocess
    % (cmd_desc, proc.returncode))
OSError: Command /Users/bob/Developme...lice/venv/bin/python - setuptools pip wheel failed with error code 1

Seems like it is related to an open issue in conda.
Conda issue 1367

I encountered this problem at MacOS Sierra 10.12.2. I solved my problem by a command like this:
cp /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/lib-dynload/_io.so test2env/lib/python2.7/lib-dynload
where test2env is the created virtual-env folder by "virtualenv test2env".  Previously the command "virtualenv test2env" failed, so that there was no "pip" in the test2env/bin folder. And the created python failed to "import io"
But after the copy,  this command succeeded:
test2env/bin/python -m "import io"
The magic is that, after the copy, any new "virtualenv " command succeeded.  I have no idea why, but it did happen to me.


Training time on GPUs

Hi guys, thank you for sharing this great model.
I have only one issue - training time.
I have 8 GPUs, each more than 20Gb, and I tried to train the model on 15,000 examples (size 200 x 200) with batch size 1,
but it took 1h! for me. Is it ok? Or do I have some issues?
PyTorch > 2.0.
Model = HATx2

@aleksmirosh The input size is too large. 4848 or 6464 are commonly used.

@aleksmirosh The input size is too large. 48x48 or 64x64 is commonly used.

thank you for responding!


5.1/AC3 passtrough not working

I'm submitting a ...

[x ] bug report
[ ] feature request
[ ] support request

General infomration
I can't get the AC3/5.1 passtrough to work with the Netflix Plugin. Iam using a Rpi3 (libreelec, KODI 18 alpha 2). Latest Netflix Plugin from your repository.
When i play a .mkv movie from my hdd the DTS/DD5.1 passtrough works fine. But when I play a movie using the netflix plugin my AVR does not detect the DD5.1 signal. I activated the DD setting in the plugin options.
What do you think?
Thanks for your help in advance and thank you for the plugin. Except for the audio passtrough everything works fine here. :)
Prerequisites

[x ] Are you running the latest version?

Description
[Description of the bug or feature]
Steps to Reproduce

[First Step]
[Second Step]
[and so on...]

Expected behavior: [What you expected to happen]
Actual behavior: [What actually happened]
Context (Environment)
Installation

[ ] I installed the plugin via zip from the Releases page
[x] I´m using the Netflix Repo
[ ] I´m using a different source (Please tell which)

Operating System

[ ] Linux (x86/x64)
[ ] OSX (x86/x64)
[ ] Windows (x86/x64)
[ x] Linux (ARM)
[ ] Android

Additional informatin on the environment
[Descripe your environment a bit more detailed, are you using LibreElec f.e.]
Debug log
[Please include a link to your debug log (use something like http://sprunge.us/) or similar, please do not paste]
Other information
[e.g. detailed explanation, related issues, suggestions how to fix, links for us to have context, etc.]
Screenshots
[Please add a screenshot if that helps understanding your problem]
[You can erase any parts of this template not applicable to your Issue.]

I'm getting the same issue with Windows. Hi-res bitstream all works fine for files and tv but not Netflix, the codec info shows 5.1 but the av receiver always gets stereo PCM.


AADB2C: Unable to connect to the metadata endpoint

Hello,
I was trying to set up my test AD FS (on a on-premise server) as SAML identity provider in b2c.
When I was testing the custom policy, I got the error "AADB2C: Unable to connect to the metadata endpoint"

note:
The AD FS server is an on-prem machine;
I was running the test on the AD FS server;
I could access the metadata from the URL on the AD FS server;

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 592d4c02-12f0-c2ac-c2ea-f454fe4bb148
Version Independent ID: 52333b29-3f21-6a72-a59c-6f59a72b9ecd
Content: Add AD FS as a SAML identity provider by using custom policies - Azure AD B2C
Content Source: articles/active-directory-b2c/identity-provider-adfs-saml.md
Service: active-directory
Sub-service: b2c
GitHub Login: @msmimart
Microsoft Alias: mimart

To investigate this issue we nee the correlation ID. Could you please share the correlation ID?

@yoelhor  Correlation ID: c029b55a-cb2a-4881-aa50-23430adcc739

Sounds like you have an AD-FS identity provide "ADFSTestExchange1" configure in your policy. The metadata of that identity provider must be publicly available (allows Azure AD B2C to read the metadata). I have tried to access that SAML metadata without success.  Please make sure the SAML metadata endpoint is accessible outside your network (publicly available).
Another option you may consider. Last week we published the Add AD FS as an OpenID Connect identity provider article. This new article uses OpenId connect instead of SAML.
Hope that clarifies your question. Should you have any questions, please replay here.

@yoelhor  thanks for your reply
I tried the openid approach. seems the metadata also requires public access.
Is it possible the corpnet ADFS can be integrated to Azure AD B2C as an SAML identity provider?
here's our use case:
We have a web application that currently uses AAD B2C for authentication. Customers can use their own Azure AD account or B2C account to use our application.
Now customer wants to use their workplace credentials (Microsoft AD DS infra, internal only) to sign in (SSO) our application. I'm wondering if it is possible to integrate to our existing AAD B2C authentication workflow.

You can download the SAML metadata from your corporate network. Then, upload the metadata in any publicly available web address. For example, use Azure blob storage. Or host the metadata in your web application. Just make sure the metadata has anonymous access, and available from the web.

Thank you. It works!