finetune pretrained model

Hi,
I am trying to finetune a pretrained Mobilenet emb256 model using the MS1MV3 dataset,
I use the following code:
tt = train.Train(data_path, save_path='check_mobile.h5', eval_paths=eval_paths,
    basic_model=None,
    model="pretrained_models/keras_mobilenet_emore_adamw_5e5_soft_baseline_before_arc_E80_BTO_E2_arc_sgdw_basic_agedb_30_epoch_119_0.959333.h5",
    lr_base=0.0001, lr_decay=0.1, lr_decay_steps=[90, 100], batch_size=256, random_status=0)
optimizer = tfa.optimizers.SGDW(learning_rate=0.0001, weight_decay=5e-6, momentum=0.9)

tt.train_single_scheduler(loss=losses.ArcfaceLoss(scale=64), epoch=2, optimizer=optimizer, initial_epoch=0)

After only one epoch the results of the model collapse
Is there any reason why it's happening?

What is the error info? Technically it should be basic_model=xxx_basic_xxx.h5, model=None.
tt = train.Train(data_path, save_path='check_mobile.h5', eval_paths=eval_paths,
    basic_model="pretrained_models/keras_mobilenet_emore_adamw_5e5_soft_baseline_before_arc_E80_BTO_E2_arc_sgdw_basic_agedb_30_epoch_119_0.959333.h5",
    model=None,
    lr_base=0.0001, lr_decay=0.1, lr_decay_steps=[90, 100], batch_size=256, random_status=0)
optimizer = tfa.optimizers.SGDW(learning_rate=0.0001, weight_decay=5e-6, momentum=0.9)

# May train 2 epoches of header only by setting `bottleneckOnly=True`
# tt.train_single_scheduler(loss=losses.ArcfaceLoss(scale=64), epoch=2, optimizer=optimizer, bottleneckOnly=True, initial_epoch=0)
# Set a new optimizer after `bottleneckOnly=True`
# optimizer = tfa.optimizers.SGDW(learning_rate=0.0001, weight_decay=5e-6, momentum=0.9)

tt.train_single_scheduler(loss=losses.ArcfaceLoss(scale=64), epoch=2, optimizer=optimizer, initial_epoch=0)

Hi,
Thanks for the answer, I tried to execute your suggested code to fine-tune the model,
it first runs two epochs to fine-tune the bottleneck layer, then another two epochs to fine-tune all model
tt = train.Train(data_path, save_path='check_mobile.h5', eval_paths=eval_paths, basic_model="pretrained_models/keras_mobilenet_emore_adamw_5e5_soft_baseline_before_arc_E80_BTO_E2_arc_sgdw_basic_agedb_30_epoch_119_0.959333.h5",    model=None,    lr_base=0.0001, lr_decay=0.1, lr_decay_steps=[90, 100], batch_size=256, random_status=0)
optimizer = tfa.optimizers.SGDW(learning_rate=0.0001, weight_decay=5e-6, momentum=0.9)
tt.train_single_scheduler(loss=losses.ArcfaceLoss(scale=64), epoch=2, optimizer=optimizer, bottleneckOnly=True, initial_epoch=0)
optimizer = tfa.optimizers.SGDW(learning_rate=0.0001, weight_decay=5e-6, momentum=0.9)
tt.train_single_scheduler(loss=losses.ArcfaceLoss(scale=64), epoch=2, optimizer=optimizer, initial_epoch=0)

The fine-tuning of the bottleneck layer runs perfectly, after that, the training collapse with OOM error
I can't understand what is the reasons, since the model is already stored in the tt object
the is the error message that I received:
"Allocator (GPU_0_bfc) ran out of memory trying to allocate 392.00MiB (rounded to 411041792)requested by op model/conv_dw_3_bn/FusedBatchNormV3"

Hi,
Thanks for the answer, I tried to execute your suggested code to fine-tune the model,
it first runs two epochs to fine-tune the bottleneck layer, then another two epochs to fine-tune all model
tt = train.Train(data_path, save_path='check_mobile.h5', eval_paths=eval_paths, basic_model="pretrained_models/keras_mobilenet_emore_adamw_5e5_soft_baseline_before_arc_E80_BTO_E2_arc_sgdw_basic_agedb_30_epoch_119_0.959333.h5",    model=None,    lr_base=0.0001, lr_decay=0.1, lr_decay_steps=[90, 100], batch_size=256, random_status=0)
optimizer = tfa.optimizers.SGDW(learning_rate=0.0001, weight_decay=5e-6, momentum=0.9)
tt.train_single_scheduler(loss=losses.ArcfaceLoss(scale=64), epoch=2, optimizer=optimizer, bottleneckOnly=True, initial_epoch=0)
optimizer = tfa.optimizers.SGDW(learning_rate=0.0001, weight_decay=5e-6, momentum=0.9)
tt.train_single_scheduler(loss=losses.ArcfaceLoss(scale=64), epoch=2, optimizer=optimizer, initial_epoch=0)
The fine-tuning of the bottleneck layer runs perfectly, after that, the training collapse with OOM error
I can't understand what is the reasons, since the model is already stored in the tt object

the is the error message that I received:
"Allocator (GPU_0_bfc) ran out of memory trying to allocate 392.00MiB (rounded to 411041792)requested by op model/conv_dw_3_bn/FusedBatchNormV3"

I forgot if it's a fp16 model or not, may try if creating model in fp16, then reloading weights help.
keras.mixed_precision.set_global_policy("mixed_float16")

import models
basic_model = models.buildin_models("mobilenet", dropout=0, emb_shape=256, output_layer='GDC', use_bias=True, scale=False)
basic_model.load_weights('pretrained_models/keras_mobilenet_emore_adamw_5e5_soft_baseline_before_arc_E80_BTO_E2_arc_sgdw_basic_agedb_30_epoch_119_0.959333.h5')

tt = train.Train(..., basic_model=basic_model, ...)

In my basic test, batch_size=256 requires 6065MiB GPU memory.


Advantage or Returns

Hi Danijar,
Thanks so much for developing and sharing this algorithm.  I've been following your work for some time and I think it's really great.
I'm attempting a re-implementation from scratch in pytorch and I have a question about the actor loss.
In the paper the loss is provided as...

However I see in the code we have something that looks more like an advantage estimate.
      rew, ret, base = critic.score(traj, self.actor)
      offset, invscale = self.retnorms[key](ret)
      normed_ret = (ret - offset) / invscale
      normed_base = (base - offset) / invscale
      advs.append((normed_ret - normed_base) * self.scales[key] / total)

If I'm interpreting the code correctly, normed_base seems to come from the value of the state the actor was in prior to transition, and normed_ret is the percentile scaled return as per the paper.
Also there is a little trick at the end..
    loss *= sg(traj['weight'])[:-1]

where 'weight' is computed as exponentially discounting the models future predictions
    cont = self.heads['cont'](traj).mode()
    traj['cont'] = jnp.concatenate([first_cont[None], cont[1:]], 0)
    discount = 1 - 1 / self.config.horizon
    traj['weight'] = jnp.cumprod(discount * traj['cont'], 0) / discount

This all makes sense, and is a good policy gradient, but in the paper it's mentioned that it's important to keep the scale of the policy gradient loss proportional to the entropy.
I noticed a big difference in policy gradient scale between using the returns as presented in the paper, and what we have here.
Would be great if you can clarify.  Did I just misread the paper, or are these simply implementation details that don't matter a whole lot in practice?

Hi @DuaneNielsen, the return is normalized as described in the paper. And the value baseline is normalized by the same statistics so that they are in the same space. They are then subtracted. Effectively, this means the advantage is normalized by the statistics of the return (not of the advantage). Does that answer your question?

Oh yeah.  I get the value baseline is normalized by the same amount, so the advantage is normalized by the percentile scale.  That's clear.
But empircally, the scale of normed_ret - normed_base is going to be about 20 times smaller than the scale of normed_ret - zero. I think...
So this will increase the role the entropy loss will play quite a bit.  ie:  if you use the advantage loss, you will explore a whole lot more.  I noticed this when I ran tests.
Does that makes sense?  Or do you think my reasoning/math is misguided?

The papers shows the gradient of the expectation of the (normalized) return. If you estimate that gradient using Reinforce with baseline, you get the expectation of the (normalized) advantage times the gradient of the policy logprob that's implemented in the code.
It's easy to confuse the two but the first one talks about returns and has the gradient outside of the expectation, whereas the second one talks about advantages and has the gradient inside. So the two are actually the same, despite looking different at first sight.

Thanks a lot for clearing that up Danijar.  I missed the subtlety of the expectation being on the oustide, so I'll try deriving that to prove it to myself.  Thanks for sharing the code and thanks for creating this wonderful algorithm!

Cool! The derivation for Reinforce is basically this:
grad_pi E_pi(a|s)[ R(s,a) ]
= grad_pi sum_a pi(a|s) R(s,a)
= sum_a R(s,a) grad_pi pi(a|s)
= sum_a pi(a|s)/pi(a|s) R(s,a) grad_pi pi(a|s)
= sum_a pi(a|s) R(s,a) (grad_pi pi(a|s)) / pi(a|s)
= sum_a pi(a|s) R(s,a) grad_pi log pi(a|s)
= E_pi(a|s)[ R(s,a) grad_pi log pi(a|s) ]

Then you can also show that subtracting a "baseline" from R(s, a) that doesn't depend on on a doesn't introduce any bias:
grad_pi E_pi(a|s)[ V(s) ]
= grad_pi sum_a pi(a|s) V(s)
= V(s) grad_pi sum_a pi(a|s)
= V(s) grad_pi 1
= V(s) 0
 = 0

If you put these together, you get:
grad_pi E_pi(a|s)[ R(s,a) - V(s) ]
= grad_pi E_pi(a|s)[ A(s,a) ]
= E_pi(a|s)[ A(s,a) grad_pi log pi(a|s) ]

Now if you follow these derivations but with the return and baseline being normalized as in DreamerV3 where lo and hi are the percentiles 5 and 95 of the return batch (and possibly smoothed out over time with EMAs), you get:
grad_pi E_pi(a|s)[ (R(s,a) - lo) / max(1, hi - lo) - (V(s) - lo) / max(1, hi - lo) ]
= grad_pi E_pi(a|s)[ ((R(s,a) - lo) - (V(s) - lo)) / max(1, hi - lo) ]
= grad_pi E_pi(a|s)[ (R(s,a) - lo - V(s) + lo) / max(1, hi - lo) ]
= grad_pi E_pi(a|s)[ (R(s,a) - V(s)) / max(1, hi - lo) ]
= grad_pi E_pi(a|s)[ A(s,a) / max(1, hi - lo) ]
= E_pi(a|s)[ A(s,a) / max(1, hi - lo) grad_pi log pi(a | s) ]

By the way, I think this can also be explained much better in the paper. We'll update it at some point.

Just leaving a note to let you know I managed to get the algorithm working in PyTorch.  Aside from a few minor details I think I"m pretty close.  The code is still a bit rough, so after more testing, I'll probably rewrite the whole thing.  Repo here


[FR] Idea for subcategory tree view

Problem
As a part of Bootstrap 5 introduction (#2205), category treeview was removed in favor of "Subcategory tab".
This leads to unnecessary clicks when user wants to change category outside of currently opened branch.
Suggested solution
Add drop-down category list to the header of every part/stock view with the same content as in "subcategory tab". Active category should be highlighted and selected.
This list could be combined with current breadcrumbs.

Mockups:

Describe alternatives you've considered
Restore old category tree view.
Do you want to develop this?
Unfortunately it is above my head.

@SchrodingersGat @eeintech this is not assigned to a milestone. Are we interested in this or wontfix?

I use this category tree a lot in 0.5.x so yeah I would love to see it restored!

I think we should add the category tree back in some form for 0.6.0

@eeintech @matmair clearly this was a popular feature! Let's work out a nice way of integrating it back in.

@SchrodingersGat should we solve this with an api powered widget? That could be conditional on when the  bar is opened.

Yes definitely should be loaded via the API

@SchrodingersGat https://www.jstree.com/docs/json/ combined with an API endpoint seems like a good option. If the tree is visible we can load the root + the current branch and if any other branch is opened the data in that branch is loaded on the fly via ajax.

Working on this feature rn


fixes #381

Signed-off-by: ktpv<EMAIL_ADDRESS>

Redid in PR #404. Closing this out.


Handle Bad Files in GET Requests

As a user of the OSCAL Rest Service that is accessing local files, I want a more lenient system for accessing my OSCAL files.
Currently, a user of the OSCAL Rest Service that is setting up a local environment is expected to create an OSCAL content directory with a specific directory structure (see the all-in-one deployment README). The directory structure is simple enough, but if a user includes any files that are not properly formatted OSCAL JSON files, a 500 error is given with little feedback to the user.
There are several ways this can occur:

A non-JSON file is included in one of the OSCAL file directories
A directory exists within one of the OSCAL file directories
The user tries to GET an improperly formatted OSCAL object

Acceptance Criteria

If a directory or non-JSON file exists in the catalogs, component-definitions, profiles, or  system-security-plans directories (or their equivalents, if renamed by the user), a corresponding GET request (eg. GET localhost:1234/oscal/v1/system-security-plans) ignores those files and does not return a 500 error.
If an improperly formatted OSCAL JSON file is requested (such that would cause a 500 error), a more descriptive error is provided to the user that points out which file is incorrect, and if possible, what the original parsing error was.

Implementation Notes

Test files to reproduce should be added to a repository of OSCAL content used purely for testing

This is actually really interesting because I know (uhh well now I feel like maybe just think) that I've seen the service ignore README.md files and other types. So it is interesting that it seems like some files result in a 500 but others don't. I wonder if some of the workarounds that we had to do in #50 are causing us to be a little too fragile and not hitting the "non-OSCAL content" check. But even still, 500ing on directories and improperly structured OSCAL is a problem.
Hopefully this is just some fixes to findAll but we may need to do better about handling the related errors correctly throughout the stack (logging vs continuing to throw) or perhaps using Advice like we've done elsewhere for exceptions.
https://github.com/EasyDynamics/oscal-rest-service/blob/9be377026361c58615301ff56eb9848fd8482bd3/oscal-data-repository-file/src/main/java/com/easydynamics/oscal/data/repository/file/BaseOscalRepoFileImpl.java#L212-L236
Additionally, we need to be careful about how we define "a more descriptive error is provided to the user". This very likely should be a log message and not data that is sent over the HTTP response.  We don't want to get into a habit of sending debugging info about server-side errors over the wire. Perhaps detail this is too technical for an AC but I think we can solve the same problem by more clearly defining "user" for the purpose of this ticket; possibly in this case we want to think of the user as someone deploying/managing/operating the OSCAL Rest Service?

I've seen the service ignore README.md files and other types

Yes, and the tests are using oscal-demo-content which intentionally includes a README.md in the SSPs folder.
@hreineck, do you have more detail on specific files or scenarios where this is occurring?

I've seen the service ignore README.md files and other types

Yes, and the tests are using oscal-demo-content which intentionally includes a README.md in the SSPs folder.
@hreineck, do you have more detail on specific files or scenarios where this is occurring?

Specifically, this happens when I run the REST service in the all-in-one Docker deployment and I include a random file in the oscal-content/system-security-plans directory. When I try to open the SSP tab of the OSCAL Editor (which is running from the Docker container at localhost:8080), it gives the 500 error.
This file can be named anything as far as I can tell; as long as it is not formatted  as  JSON file with a system-security-plan root object, it gives a 500 error.
The REST Service shows this error:

The relevant bit seems to be failed to find root field.
And network tools on the browser shows that the 500 is a response to a GET request at http://localhost:8080/oscal/v1/system-security-plans
A 500 also occurs if there is a sub-directory within oscal-content/system-security-plans, in which the REST service outputs the error Is a directory:

In both cases, the OSCAL Editor gives this standard error message:

Okay so looking into this a bit, I think we can actually solve this in getValidedPathContents(). File.listFiles() has an overload that accepts a FileFilter. At least to ignore directories, we can do:
File[] pathContents = pathFile.listFiles(File::isFile);

but then we mostly end up still accepting otherwise invalid files. But I also don't know that inserting that logic into the FileFilter is entirely appropriate. Anything we do there is likely to be less-than-perfect because it would be hard to base it on the behavior of the liboscal-java load logic.
So I also feel like in findAll() we just remove the if/else. We shouldn't just crash because there's something there that we can't parse. I think we should just silently (to the end user, but as a debug/info message to the server logs) skip that particular file as a return value. Now this means that if something wonky happens to the file (somehow we serialize invalid data) the end user may not be able to retrieve it. For today's model where we expect the service is semi-local to the end user (in a Docker container on the same host/network), I think this may be acceptable. Fundamentally, bad OSCAL, random JSON, or a README file are all going to be mostly the same to the API (they'd be an invalid response). And it's probably better for a list operation to return at least as much as we can to the user (of course, I'd have different opinions for other types of operations). This means, in my opinion, findAll should not directly through a DataRetrievalFailureException because at the end of the day, it's not really worth crashing over at this point.
If we want to support nested directories, I think we should open a feature request to support that feature outside of this immediate bug report.

Using @kylelaker's suggestions to ignore dir files and to not throw and exception when getting an IOException seems to be on the right track, but I wanted to hear your opinion on intended functionality.
I've been trying to further test findAll() and have found that the functionality when loading multiple OSCAL Objects when one has a parsing error is strange. findAll() returns all files that are considered parsable, even if they are not technically valid (like changing the components field to componetz). Once you try to view them in the editor, it seems that all of the OSCAL objects display Yikes! Something went wrong loading the OSCAL data. after loading an invalid object.  This warning persists regardless of you trying to load another object of the same type or switching to and from REST mode.
I am unsure if that is something that is an issue due to how findAll() returns even invalid OSCAL Objects, with how the React Library handles loading between modes and files, or a combination of both.

Once you try to view them in the editor, it seems that all of the OSCAL objects display Yikes! Something went wrong loading the OSCAL data. after loading an invalid object. This warning persists regardless of you trying to load another object of the same type or switching to and from REST mode.

This is an issue with oscal-react-library. Specifically, the way the ErrorBoundary is handled (and the state surrounding it). I've been meaning to write something up on this but was waiting until I sorta understood the problem more; I think I should just go ahead and do my best at this point though. I will open a Bug there. FWIW, you can reproduce in the Viewer by putting in an invalid URL -- entering a valid URL never "fixes" it unless you reload the whole page.

I am unsure if that is something that is an issue due to how findAll() returns even invalid OSCAL Objects

To be clear though, if this is in fact happening, that is a problem and needs to be fixed. The service must never return bad data (but should also not crash because it is present).


Exception while stopping a Node

Should protect against NoneType exception.
Exception in thread node-stop:
Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/threading.py", line 810, in __bootstrap_inner
    self.run()
  File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/threading.py", line 763, in run
    self.__target(*self.__args, **self.__kwargs)
  File "/Users/debbabi/Downloads/cohorte-1.1_5.0/repo/cohorte/monitor/basic.py", line 442, in _stop_node
    self._composer.set_platform_stopping()
AttributeError: 'NoneType' object has no attribute 'set_platform_stopping'

We also lose stdin in several cases!


No disk left on device

Description
This is not a bug, but I found no other option for asking about it. I am trying to run a workflow that depends on a large file (35 Gb when decompacted). I am aware of the 14 Gb limitation, which is already very generous.
Is this workflow impossible to run with GitHub actions? Or is there some way to make it work?
Virtual environments affected

[X] Ubuntu 18.04
[ ] Ubuntu 20.04
[ ] macOS 10.15
[ ] macOS 11
[ ] Windows Server 2016
[ ] Windows Server 2019
[ ] Windows Server 2022

Image version and build link
20211129.1
https://github.com/iquasere/reCOGnizer/runs/4410554469?check_suite_focus=true
Is it regression?
Nop, it never worked
Expected behavior
It works locally, but GitHub actions fails.
Actual behavior
It is actually reporting as a success, but the run job always fails.
Repro steps
Rerun the workflow? Dunno what this about

You can try cleaning up runner and then unpacking the file

Free space step
Remove tools you require from below step
      - name: Clean runner
        run: |
          set -x
          echo "::group::installed"
          apt list --installed
          echo "::endgroup::"
          echo "::group::packages"
          #
          sudo apt-get -yq update
          # apt-get packages to uninstall
          packages=(
            ant
            ant-optional
            apache2
            azure-cli
            mongodb-org
            r-base
            ruby-full
            postgresql
            postgresql-client
            libpq-dev
            chrpath
            libssl-dev
            libxft-dev
            libfreetype6
            libfreetype6-dev
            libfontconfig1
            libfontconfig1-dev
            nginx
            mssql-tools
            unixodbc-dev
            mysql-client
            mysql-server
            libmysqlclient-dev
            mono-complete
            nuget
            mercurial
            hhvm
            ghc*
            gh
            gfortran*
            g++*
            esl-erlang
            dotnet-sdk*
            podman
            buildah
            skopeo
            google-cloud-sdk
            clang-*
            lldb-*
            lld-*
            clang-format-*
          )
          #
          sudo apt-get remove --allow-remove-essential -y ${packages[@]}
          echo "::endgroup::"
          echo "::group::paths"
          # paths to rm -rf
          paths=(
              /opt
              /tmp/*
              /etc/skel
              /usr/local
              /usr/lib/llvm*
              /usr/lib/mono
              /usr/lib/gcc
              /usr/lib/rustlib
              /usr/share/sbt
              /usr/share/ant
              /usr/share/java
              /usr/share/az_*
              /usr/share/mono*
              /usr/share/php*
              /usr/share/rust
              /usr/share/swift
              /usr/share/gradle*
              /usr/share/dotnet
              /usr/share/miniconda
              /usr/share/ImageMagick*
              /usr/share/apache-maven*
              /usr/local/bin
              /usr/local/julia*
              /usr/local/aws-cli
              /usr/local/graalvm
              /usr/local/cmake*
              /usr/local/sqlpackage
              /usr/local/share/boost
              /usr/local/share/chrome_driver
              /usr/local/share/gecko_driver
              /usr/local/share/chromium
              /usr/local/share/phantomjs*
              /usr/local/share/powershell
              /usr/local/share/cmake-*
              /usr/local/share/vcpkg
              /usr/local/share/.cache
              /usr/local/lib/lein
              /usr/local/lib/android
              /usr/local/lib/heroku
              /usr/local/lib/node_modules
              /usr/local/lib
              /usr/lib/node_modules
              /usr/lib/jvm
              /home/linuxbrew
          )
          #
          sudo rm -rf ${paths[@]}
          echo "::endgroup::"
          sudo swapoff -a
          echo "::group::files"
          # files to rm -f
          files=(
            /swapfile
            /usr/bin/yq
            /usr/bin/composer
            /usr/bin/google-chrome
            /usr/bin/chromium-browser
            /usr/bin/chromium
            /usr/local/bin/aliyun
            /usr/local/bin/azcopy
            /usr/local/bin/bicep
            /usr/local/bin/oras
            /usr/local/bin/bazel
            /usr/local/bin/vercel
            /usr/local/bin/rebar3
            /usr/local/bin/now
            /usr/local/bin/oc*
            /usr/local/bin/terraform*
            /usr/local/bin/minikube
            /usr/local/bin/kubectl
            /usr/local/bin/kustomize
            /usr/local/bin/kind
            /usr/local/bin/pulumi*
            /usr/local/bin/phpunit
          )
          #
          sudo rm -vf ${files[@]}
          echo "::endgroup::"
          echo "::group::misc"
          #sudo ./images/linux/scripts/uninstallers/php.sh
          #
          sudo docker system prune -a -f
          #
          sudo apt-get -y autoremove
          sudo apt-get -y clean
          sudo rm -rf /var/cache/*
          echo "::endgroup::"
          echo "::group::spacecheck"
          df -H -a
          echo "::endgroup::"

Hey, @iquasere
We provide only 14GB - https://docs.github.com/en/actions/using-github-hosted-runners/about-github-hosted-runners. If you need more free space you can use a self-hosted runner - https://docs.github.com/en/actions/hosting-your-own-runners/about-self-hosted-runners


Fix build break from macOS - Auth merge

master and the macOS branch were inconsistent about naming of kPassword and kFakePassword. I fixed the compile failure by making it kFakePassword. Auth team may want to revisit.
With this change All iOS and MacOS unit tests succeed.

Thanks.
It looks like travis only runs when there is a commit on the branch. Since the changes from yesterday's changes merged cleanly in, it didn't trigger the travis build before doing the merge.
Next time on a big PR, I'll force a travis run on the branch or do it manually before merging.


Don't include type name in ReportValidationErrors

Using ReportValidationErrors produces a distorted field path because the
type name from the errors is included. This can cause a "namespace"
like:
Struct1Name.Field1Name.Field2Name.Struct2Name.Field3Name

This change strips out the type name from the errors when they are being
appended to an existing namespace.
I would prefer for the struct name to never be included (I have to work around this in my application), but I suspect this would be a more disruptive change.
@go-playground/admins

Hey @aaronlehmann would you be able to produce an example outlining the issue, I'm not quite sure I fully have my head wrapped around the issue and why adjusting the relative namespace wouldn't work?

I encountered the issue when I needed to wrap part of the validation of a struct to make the validation conditional. The data structures look sort of like this:
type Model struct {
        Items []*Item `json:"items"`
        ...
}

type Item struct {
        Validate bool
        Str1 `validate:required`
        ...
}

Basically, I only want to validate the items in Items that have Validate set to true. Because of this, I can't use dive. So what I'm doing is registering a struct validation with this logic:
func init() {
        validator.RegisterStructValidation(validateModel, Model{})
}

func validateModel(sl validator.StructLevel) {
        model := sl.Current().Interface().(Model)
        for i, item := range quote.Items {
                if !item.Validate {
                        continue
                }

                err := sl.Validator().Struct(item)
                if errs, ok := err.(validator.ValidationErrors); ok {
                        sl.ReportValidationErrors(fmt.Sprintf("items[%d].", i), fmt.Sprintf("Items[%d].", i), errs)
                }
        }

In a request handler, I call validator.Struct() on a Model. I get back errors with namespace values like Model.Items[0].Item.Str1, but would expect Model.Items[0].Str1. The additional type name that gets inserted doesn't make sense and can't really be filtered out on my side.
The changes here check if there's a namespace prefix in ReportValidationErrors, and if there is, it strips out the struct name from the errors, so we don't end up with a namespace that contains an unexpected struct name in the middle.
For me it would be ideal to never include any struct names in the "namespace" value. I only want to report the fields with problems to my users, not my type names (which are internal). But it's easy for me to strip out the first item in the namespace string as a type, and with this change I can keep on doing that.

@aaronlehmann sorry for my late replies, been getting all settled after my move.
I see how this would be useful, never expected anyone to use it that way, but makes perfect sense :)
I do have some concerns about a couple pieces of code will comment on in the review; and if you could provide test for 100% test coverage that would also be great!

This is what also bothers me. The type information is redundant. Probably in almost all cases.
E.g If you validate the struct that you fill from form. Then the easiest mapping of Errors to form fields is just the Field name.

@mvrhov if I understand you correctly, the problem then becomes the consistency of how errors are used/handled, the top level ones don't have type info, but nested ones do?
IMO this would only be a sources of confusion and pain for those wanting to write wrappers around handling of the errors.

There is no type info anywhere in the chain. Just the fieldds

@mvrhov I must not be understanding correctly, can you provide an example?

If we take the structs from example simple, then I'd expect the following:
I'll use json notation:
{
"FirstName": "error string",
"Addresses[X].Street":  "error string",
"Addresses[Y].Planet":  "error string",
}

And not:
{
"User.FirstName": "error string",
"User.Addresses[X].Address.Street":  "error string",
"User.Addresses[Y].Address.Planet":  "error string",
}

// User contains user information
type User struct {
	FirstName      string     `validate:"required"`
	LastName       string     `validate:"required"`
	Age            uint8      `validate:"gte=0,lte=130"`
	Email          string     `validate:"required,email"`
	FavouriteColor string     `validate:"iscolor"`                // alias for 'hexcolor|rgb|rgba|hsl|hsla'
	Addresses      []*Address `validate:"required,dive,required"` // a person can have a home and cottage...
}

// Address houses a users address information
type Address struct {
	Street string `validate:"required"`
	City   string `validate:"required"`
	Planet string `validate:"required"`
	Phone  string `validate:"required"`
}

@mvrhov I see what you mean, I have it this way due to type interface{} where the type is not guaranteed then the error will allow differentiation of the two, especially if they have the same field names.
Perhaps it's overkill though, I'll add a ticket about possibly removing it for v10, until then going to close this out as it'd be a breaking change right now.


 at the end of paragraphs

I am using the Demo.html file and <br> tags are added at the end of the paragraphs. How to remove them?

This is part of what is required in many browers to prevent the paragraph collapsing when it has no text content. The easiest thing if you really want to get rid of them, is to do a post-processing step to walk the DOM tree and remove them if safe. This is not part of the editor itself though, so closing this.


GUI - v0.8.0-rc.2 (Selection of inactive attributes )

I'm submitting a ...

[x] bug report
[ ] feature request
[ ] support request

When you select an attribute, it becomes inactive for selection.

Note: When selecting any widget, attribute selection does not work

Please tell us about your environment:

Version: 0.8.0 - rc2
Environment: [docker-compose]
Operating system: [Ubuntu 16.04]

Ticket tested in version 0.8.0-rc6


generating bitfield/bytefield tables

it can be quite useful for a standard to include a bitfield/bytefield representation of a protocol data object.
For example, RFC 1035 §4.1.1 contains:
                                    1  1  1  1  1  1
      0  1  2  3  4  5  6  7  8  9  0  1  2  3  4  5
    +--+--+--+--+--+--+--+--+--+--+--+--+--+--+--+--+
    |                      ID                       |
    +--+--+--+--+--+--+--+--+--+--+--+--+--+--+--+--+
    |QR|   Opcode  |AA|TC|RD|RA|   Z    |   RCODE   |
    +--+--+--+--+--+--+--+--+--+--+--+--+--+--+--+--+
    |                    QDCOUNT                    |
    +--+--+--+--+--+--+--+--+--+--+--+--+--+--+--+--+
    |                    ANCOUNT                    |
    +--+--+--+--+--+--+--+--+--+--+--+--+--+--+--+--+
    |                    NSCOUNT                    |
    +--+--+--+--+--+--+--+--+--+--+--+--+--+--+--+--+
    |                    ARCOUNT                    |
    +--+--+--+--+--+--+--+--+--+--+--+--+--+--+--+--+

It would be great to be able to generate tables like this that would at least use colspan attributes (which are supported in xml2rfc v3).
I'm aware that most markdown variants don't support colspan (multimarkdown seems to be the exception.
It's also conceivable that we'd want rowspan attributes for larger blocks, but colspan seems like the most likely thing here.

This assumes tables are a good way to represent box notation.
kramdown-rfc provides support for the tool protocol to generate box notation as traditional ASCII art, and for goat to convert this into an equally-spaced SVG figure.
I'm afraid this isn't fully documented yet, but see https://github.com/cabo/kramdown-rfc2629/wiki/SVG#goat for goat.
Separately: Yes, we need a good way to represent rowspans and colspans in tables.
Unfortunately, the upstream (kramdown) table syntax does not provide that yet.
https://github.com/gettalong/kramdown/issues/87 shows work that we could pick up.
This is on the agenda, just not very high up at the moment...

Try
~~~ protocol-goat
Source:16
Reserved:40
TTL:8
~~~

or
~~~ protocol-aasvg
Source:16
Reserved:40
TTL:8
~~~

until we have that documented.
(aasvg is a goat replacement with better fine positioning.)

Thanks, i really like the looks of aasvg, but it's unclear to me where i should get the protocol tool.  it looks like it is a command line tool that acts as a stdin/stdout filter, and it was added in 1c57f8fb.  What tool is this?

I now have added a bit of documentation at https://github.com/cabo/kramdown-rfc2629/wiki/SVG#protocol
Please feel free to add information there or ask further questions.

Thanks for this additional documentation, @cabo.  This is what i needed.


[BUG] App freezes after recompiling even without any changes

Information

Apktool Version (apktool -version) - 2.6.0
Operating System (Mac, Linux, Windows) - win10
APK From? (Playstore, ROM, Other) - playstore

Stacktrace/Logcat
I think doesn't matter because it doesn't crash but freezes on starting page

Steps to Reproduce
if i decompile and compile it again with 0 changes
i get [INSTALL_FAILED_INVALID_APK: Failed to extract native libraries, res=-2]
if i edited the manifest file android:extractNativeLibs="false" to android:extractNativeLibs="true"
and compiled it the app installs fine but freezes on start
Frameworks
If this APK is from an OEM ROM (Samsung, HTC, LG). Please attach framework files
(.apks that live in /system/framework or /system/priv-app)
APK
apk link
Questions to ask before submission

Have you tried apktool d, apktool b without changing anything? yes
If you are trying to install a modified apk, did you resign it? yes
Are you using the latest apktool version? yes

That error for extractNativeLibs is probably one of the culprits and we are tracking that in #2490. I don't see a logcat to triage the freezing, so will close as duplicate.

That error for extractNativeLibs is probably one of the culprits and we are tracking that in #2490. I don't see a logcat to triage the freezing, so will close as duplicate.

can reopen this ticket so i can add the logcat or should i issue another one?


Create javas.js

New Plugin Checklist
This PR introduces new gitStream plugins, please review this checklist to ensure all required components are included for each new plugin.
pluginA
Required Files

reference.md
LICENSE
plugin_a.cm

Required JSDoc Tags

@example
@license

pluginB
Required Files

reference.md
LICENSE
README.md
plugin_b.cm

Required JSDoc Tags

@description
@returns
@example
@license

New Plugin Checklist
This PR introduces new gitStream plugins, please review this checklist to ensure all required components are included for each new plugin.
pluginA
Required Files

reference.md
LICENSE
plugin_a.cm

Required JSDoc Tags

@example
@license

pluginB
Required Files

reference.md
LICENSE
README.md
plugin_b.cm

Required JSDoc Tags

@description
@returns
@example
@license

Here is the recommended JSDoc text for the missing tags in the provided code:
@description - This module is responsible for generating a markdown checklist for new plugins in gitStream. It analyzes the metadata of the new plugin files and identifies any missing plugin files or JSDoc tags.
@module - pluginChecklist


Testnet Modifications

Using CLBOSS to provide stimulation to nodes-under-test in testnet.  Needed these changes for testnet.
Open Issues:

[ ] Does the min_nodes_to_process need to be network dependent?  Would the smaller value hurt CLBOSS on mainnet?

This is superseded by #162 , #171, and #173


updated to mach OL

ignore the PointerToString, will remove in next commit

I've added a ConstCharPointer type in the latest release which you can use for the name in the sound info struct


Integration broken since 2023.8.4

Noticed since the latest update 2023.8.4 this integration apears to be broken,
full uninstall and re-install did not fix it either.
Integrations asks for IP address or auto but doesn't ask for the geko product module number.

I have the same problem, but it seems rather a Gecko Server Issue, is your inTouch app working?
Mine did not, i had to restart the device then my intouch App got connected again.
Initialisation now takes a while in HA, will update later.

Thanks for your suggestions tried the phone app and it works fine,

Removed the integration froms HACS , restarted HA, checked Gecko wasn't present in cutom integration folder.
installed integration 0.1.9 from HACS , restarted HA.
Added service , asks for IP - I leave blank for it to scan. , Selected MySpa
Success created config for MySpa.
Under Gecko, No devices or entites are listed

There doesn't apear to be an option to select the ID, fairly certain there was when I initially installed this a few months ago.
Any help would be much appreciated , thanks

I'm having the same issue, I'm able to reconnect it, but it becomes unavailable again after several minutes later.

Ahh, I’m away at present but I’ll do the HA upgrade and then try to fix the integration when I’m back.

Thanks Gazoodle, If  you need any logs or any help testing, please feel free to reach out.
Cheers

Thank you!

Thanks for taking the time to look at it. I have the same symptoms as roperstv but mine was a new installation as I've only connected the in.touch 2 this week. Assumed initially it was an issue at my end.

Hope all is well with everyone.  Just want to check on the status on this.

Still not working for me, it installs fine and finds the spa but won't list any entities.

I can't get the development container to run, so I'm in the process of diagnosing why this is the case ... might be related to HA requirement for Python 3.11 in 2023.8.*
This integration was based on @ludeeus's blueprint integration which has changed quite a bit since I last fired it up and so I need to relearn how to get the development environment running which I'm struggling with at the moment.

That's got it working. I hadn't set a Watercare, it was using the default setting of twice daily for 2 hours which is fine. I modified the Standard profile to match that and the integration is now seeing the data.

With this discussion ongoing, does anyone know how to modulate the temperature?
Kind Regards
John
On Tue, 19 Sept 2023 at 15:03, unjoking @.***> wrote:

That's got it working. I hadn't set a Watercare, it was using the default setting of twice daily for 2 hours which is fine. I modified the Standard profile to match that and the integration is now seeing the data.
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you are subscribed to this thread.Message ID: @.***>

": No entities created https://github.com/gazoodle/gecko-home-assistant/issues/67 . There is an issue if the watercare mode is out of range. It can be fixed from the in.touch app by ensuring that a valid watercare mode is actually selected..."
This fixed my issue too! :)
Thanks again gazoodle

I re-enabled the integration it was working great for a few hours and then again went unavailable.

Just wondering if there is a movement on this issue?

Logs would be useful to have. Default level is fine at present, hopefully there is some indication of why the sensor become unavailable.


[MLIR] Binary backend - step 6 - Introduce GetKernelCount API

This PR does the following:

Refactored all non-xdlops solvers to take advantage the MiirIsConfigApplicable() check to make sure no false positive exist
Bumped the MLIR commit
Introduced the MiirGetKernelCount() API to pave road for multi-kernel compilation

Previous PRs in the series:
https://github.com/ROCmSoftwarePlatform/MIOpen/pull/841
https://github.com/ROCmSoftwarePlatform/MIOpen/pull/889
https://github.com/ROCmSoftwarePlatform/MIOpen/pull/892
https://github.com/ROCmSoftwarePlatform/MIOpen/pull/902
https://github.com/ROCmSoftwarePlatform/MIOpen/pull/912

@atamazov Thanks for the review. Let me address those comments and re-run the MLIR stage. I'd prefer to address those in this PR.

@jerryyin Okay. You did it at the very last moment. I was about to merge this, but I was randomly diverted)))

FYI static checks + mlir stages passed at here.


Not able to open jpg file.

I am not able to open the jpeg file in the application.
I am using python 2.7 as specified with qt version 4.8.

You may be missing libjpeg on your system (if so, need to install it). I have just downloaded and tried the tool on a jpg image, it worked (Linux Mint 18.2, kernel 4.15, Python 2.7).


Cluster gets stuck provisioning on Esxi using RancherOS (legacy)

bug
Steps to reproduce (least amount of steps as possible):

On a new installation of Rancher, add cloud credentials for a local Esxi host.
Configure node template using Boot2docker.
Create a new, single node cluster.
Allow the cluster to provision itself until the failure occurs.

This cluster is currently Provisioning; areas that interact directly with it will not be available until the API is ready.
[workerPlane] Failed to bring up Worker Plane: [Failed to start [kubelet] container on host [<IP_ADDRESS>]: Error response from daemon: path /var/lib/rancher is mounted on / but it is not a shared mount]
Environment information

Rancher version: v2.35
Installation option: single install

Cluster information

Cluster type: Hosted, on Esxi

Machine type Esxi host running on HP z620. 16 core Xeon, 96 GB RAM,  1TB SSD:

Kubernetes: Kubernetes never started.

I've used Rancher to provision clusters before. But I installed the latest Rancher last night, re-created my creds and templates and now I'm getting the error.

Docker version (use docker version): 19.03.5

I pulled and the Rancher server images again and it worked. It looks like I didn't use the :latest tag when I pulled the images.


[feat] (ethereum) extra gas for error

use 21052 units of gas instead of 21000

Signed-off-by: Denys Bitaccess<EMAIL_ADDRESS>Subject
Description

@dylanseago updated with use of 21052 for all kinds of eth txs including sweeps


Allow a state with no selection in VButtonArray

At the moment, one of the buttons in VButtonArray has to be selected. This makes sense for keyboard/joypad controlled menus, but it doesn't feel right for touchpad/mouse oriented menus.
It would be nice if, for example, we could set Selected to -1, corresponding to the state in which none of the buttons is selected.

"Fixed" as there is no more VButtonArray in the master branch.

So I assume all 2.x related issues can be closed now

Not necessarily all of them, but old enhancements suggestions could be yeah. Actual bugs would still be worth fixing as there will still be 2.1.x releases.

If you think this one would still be worth fixing in 2.1.x, we can reopen it.

Is there any explanation why VButtonArray was removed?

ButtonArray is removed in favor of ButtonGroup.


Abstract/Generalise ContextRequest and ContextResponse

Replace "ContextRequest" and "ContextResponse" with a common class "WithContext", which does not take any parameter of Kind 1. Some existing methods, and the apply constructor, are replicated in syntax extension and objects for source-compatibility.
Introduce a 3-parameter GenHttp type alias, that extends on the existing Http one with a Kind-1 type parameter, on the Request. An Http is just the case where the new parameter is ID.  A ContextRoutes is the case where the new parameter is "WithContext" and the response wrapper is an OptionT.

The build is failing on use-site exhaustivity checks - what change would be required to fix them, and is it possible to change WithContext so that a use-site change isn't needed?

@bplommer The build seems to be working fine as of now. It was rebased to series/0.23.

This isn't bincompat, though, right? I thought we checked that in CI, but now I'm confused.

Probably CI needs to be re-run, lets' see.

There are those mima failures. Note: changing the base branch on GH does not re-run CI.

I'm on the fence about this change. By making WithContext[Msg, A] take parameters for both of its members, we've basically made it a Tuple2. This is more general, but if we want to go that route I'd just use Tuple2 directly. I think if ContextRequest and ContextResponse have any utility, it would be in that they are specific to Request and Response.
FWIW, I could be convinced either way here on whether or not to keep or remove ContextRequest/ContextResponse and replace them with Tuple2, but I'm concerned that having WithContext[A, B] may be the lesser of the three options.

I'm on the fence about this change. By making WithContext[Msg, A] take parameters for both of its members, we've basically made it a Tuple2. This is more general, but if we want to go that route I'd just use Tuple2 directly

A Tuple2 is just a case class with two "anonymous" parameters, _1 and _2. Having a separate case class allows one to have more informative field names. Otherwise, users of the library would need to read the documentation to know which one is the request or context (if they get mixed up). IMHO that is an argument of favour of case classes.


Do We require  BIP324 implementation?

Well , I  have no idea of  whether we require BIP324  implementation in rust-bitcoin .
If so ,  @rustaceanrob has implemented this in rust https://github.com/rustaceanrob/bip324  , from which we can either take reference or directly  incorporate it in our codebase .

This is a duplicate of https://github.com/rust-bitcoin/rust-bitcoin/discussions/1691


Generated codes do not match Google Authenticator results

I am using this code:
string secret = "KREQPD7NXSGO3T3B";
while (true)
{
    byte[] secretBytes = new Base32Encoder().Decode(secret);
    OtpNet.Totp totp = new OtpNet.Totp(secretBytes);
    string twoFactorCode = totp.ComputeTotp();

    Console.WriteLine("Two factor code: " + twoFactorCode);

    System.Threading.Thread.Sleep(2000);
}

Now if you take that same string (for secret) and put it in to Google Authenticator manually, you will notice that this code generates different keys. On the otherhand, if I use a different value for secret (eg "uhj34qsyuwftzji4qq6k3c3wnstdb57m") then both the values generated by OtpNet and Google Authenticator will match.
What am I doing wrong?

Is KREQPD7NXSGO3T3B a valid base32 value for a totp key?

@kspearrin I'm not sure. I was following the instructions in this article: https://dev.to/j_sakamoto/selenium-testing---how-to-sign-in-to-two-factor-authentication-2joi
Is there a way to verify that?

@kspearrin the two factor uri that I got from the QR code is like this (I have since changed my two factor code on Facebook): otpauth://totp/derekantrican?secret=KREQPD7NXSGO3T3B&digits=6&issuer=Facebook

@kspearrin Is there any way to generate otpauth that will let OtpNet and Google Authenticator match?
I am using this code:
string OtpSecretKey = "KREQPD7NXSGO3T3B";
var secretKey = System.Text.Encoding.Unicode.GetBytes(OtpSecretKey);
var totp = new Totp(secretKey);
var totpCode = totp.ComputeTotp(DateTime.UtcNow);
What am I doing wrong with the GetBytes or others?
Thanks.

I just got it.
The way to get bytes[] is wrong.
I need to use
var secretKey = Base32Encoding.ToBytes(OtpSecretKey);
Then OtpNet and Google Authenticator will match.

@shyboylpf Great, thanks! That was it!

@derekantrican Great


Crash fix.

Fixes a fatal issue when trying to present an alert.
[NSConcreteValue titleForState:]: unrecognized selector sent to instance 0xXXXXXXX

@alejandroivan Thank you for your feedback, accidentally made a low-level error

@king129 thank you for this library, it's actually pretty amazing.
If I find any other errors, I'll do more pull requests.
Thanks again!


[dv/hmac] enhancement on DV testbench

These are the items I plan to implement after design finalized:

[x] Wipe Secret Test: current hmac testbench only check if the wipe secret registers can be read and write, no functionality check.

[ ] Throughput Test: with no delays, check if the throughput meets the timing.

[x] Toggle config register (sha_en only or shall we test all of them?) between msg stream in, test DUT won't hang.

[x] Confirm on max outstanding items in this PR: https://github.com/lowRISC/opentitan/pull/10489 with designer

Add @eunchan  @sriyerg for visibility.

item 3 is finished in PR https://github.com/lowRISC/opentitan/pull/1023

@cindychip can you update the status of this issue?

They are still TODOs for HMAC to reach V3.

https://github.com/lowRISC/opentitan/pull/9185 Reference for 1) TODO

https://github.com/lowRISC/opentitan/pull/10363 Finished TODO 1).

@arunthomas
@cfrantz
is the throughput item something the software team could help with? :)
Especially since we probably care most about throughput at a system level and not just the block.

I have discussed this with @vogelpi and we both believe that is not a critical requirement. We don't have such throughput tests for other crypto blocks and thus believe we should invest our DV resources into more critical items.
I am closing this now, but feel free to re-open if you feel it should be covered.


Add LintingManager

The idea is to have one manager to handle linting / code analysis.
I would like to get some comments on this.
It would be worth considering if this belongs into CodeRefactor plugin, for example.
Other than that, what about the overall architecture?
An example for a plugin using it: https://github.com/DoclerLabs/hexDevelop/tree/haxecheckstyle/Plugins/HaxeCheckStyle

@SlavaRa ?

@Neverbirth Very broadly written, but it looks good

Why are the tests failing?

I just noticed a problem with this. When the auto completion triggers, the file is saved. Therefore, the LintingManager runs the linters and adds the results to the log. But this hides the completion list, so code completion does not work correctly anymore.
@Neverbirth proposed it would be possible to add a reason or something similar to the Save event as a possible solution.

@chipshort what do you think about c#6 and ReSharper?

To be honest, I don't really know how to feel about an extension method that only targets specific type arguments.

It can be changed to nearest interface possible. It's true it's always better to do it like that, but at any rate it's not exposed publicly so I don't think it's too much of a problem.

@SlavaRa I'm not using ReSharper right now, but I know Jetbrains usually does great stuff. About C# 6, I think I like the null conditional operator the most. Why do you ask?

@chipshort I can give you a license for a ReSharper. I ask because your code can be done in 2-3 less)

@SlavaRa Ah, thank you, but it's okay. I should be able to get a student license. :)

JettBrains gives us(fdteam) licenses for all products


Generate also models that are children of models used in endpoints

Is your feature request related to a problem? Please describe.
Yes, my problem is that some of my endpoints use contract (component) that is of type QueryCondition. But QueryCondition has subclasses like AttributeQueryCondition, SpatialQueryCondition, and others.  The openapi-python-client does not generate the subclasses in the models folder.
Describe the solution you'd like
I think this happens because parser/openapi.py walks around all endpoints and generates a model when it finds one. But this way it skips the subclasses of models used in endpoints. I would like all models present in the openapi document to be generated. Alternatively, which classes to include or exclude could be controlled by the the --config file.
I would also like the inheritance of models to be preserved in the generated models.
Describe alternatives you've considered
I've considered writing my own generator but I would much rather use one that exists and openapi-python-client seems most promising.
Additional context
Here is one of the openapi document I am working with: https://develop.mike-cloud.com/core-gis-prod/v2

To be clear, QueryCondtion would be "allOf": ["/#/components/schemas/AttributeQueryCondition", "/#/components/schemas/SpatialQueryCondition"]? All of the models in components/schemas should be generated regardless of whether or not they're used, so if it's skipping some without warning that's a bug.
I won't be adding inheritence because it creates too many weird issues with interactions between classes, ends up being a big headache to support for arbitrary combinations of things. Could be useful to add a note about composition in a generated docstring though 🤔

I think this issue was requesting inheritance, which will not be added.


c_api.h no such file or directory

Please make sure that this is a build/installation issue. As per our GitHub Policy, we only address code/doc bugs, performance issues, feature requests and build/installation issues on GitHub. tag:build_template
System information

OS Platform and Distribution (e.g., Linux Ubuntu 16.04): ubuntu 18.04
Mobile device (e.g. iPhone 8, Pixel 2, Samsung Galaxy) if the issue happens on mobile device: N/A
TensorFlow installed from (source or binary): source
TensorFlow version: 2.4.0
Python version: 3.8.3
Installed using virtualenv? pip? conda?: N/A
Bazel version (if compiling from source): 3.4.0
GCC/Compiler version (if compiling from source):  7.5.0
CUDA/cuDNN version: 11.0 / 8.0.1
GPU model and memory: GTX1080Ti GDDR5X 11GB

Describe the problem
build failed
Provide the exact sequence of commands / steps that you executed before running into the problem
bazel build //tensorflow/tools/pip_package:build_pip_package
Any other info / logs
Include any logs or source code that would be helpful to diagnose the problem. If including tracebacks, please include the full traceback. Large logs and files should be attached.
/home/wmind/.cache/bazel/_bazel_wmind/a0a15f0a32d3688786619e94912711cf/external/llvm-project/llvm/BUILD:712:11: C++ compilation of rule '@llvm-project//llvm:Analysis' failed (Exit 1)
In file included from external/llvm-project/llvm/lib/Analysis/TFUtils.cpp:14:0:
external/llvm-project/llvm/include/llvm/Analysis/Utils/TFUtils.h:12:10: fatal error: tensorflow/c/c_api.h: No such file or directory
 #include "tensorflow/c/c_api.h"

This should be fixed now. The error was caused by LLVM including a feature that needs TF but TF depends on LLVM so we needed to cut the circular compile dependency.
@joker-eph fixed this last night.

@alanpurple Can you please verify once and close the issue if this was resolved for you. Thanks!


SIG-BGP Team: Adds danehans

I have been an active contributor and org member for the past 5 months with a focus on BGP Control Plane. I intend on continuing in this role and would like to be part of the SIG-BGP team.

/cc @rastislavs @harsimran-pabla @YutaroHayakawa

IIUC, this is a process of becoming a reviewer: https://github.com/cilium/community/blob/main/CONTRIBUTOR-LADDER.md#reviewer

Thank you @YutaroHayakawa @joestringer

How can we get this merged? @joestringer @xmulligan

Sorry was on vacation. @joestringer needs to set it up on the backend


DOT label string '(' in syntax error

I want to below string to dot graph.
digraph g {
140515766050320 [label=y: (2, 2) float64, color=orange, style=filled]
140515766047504 [label=Mul, color=lightblue, style=filled, shape=box]
140515766047248 -><PHONE_NUMBER>47504
140515766046992 -><PHONE_NUMBER>47504
140515766047504 -><PHONE_NUMBER>50320
140515766047248 [label=x0: (2, 2) float64, color=orange, style=filled]
140515766046992 [label=x1: (2, 2) float64, color=orange, style=filled]
}

but I got this error, syntax error in line 2 near ':'. So I remove this string : and run below dot code.
digraph g {
140515762284624 [label=y(2, 2) float64, color=orange, style=filled]
140515762285072 [label=Mul, color=lightblue, style=filled, shape=box]
140515762285776 -><PHONE_NUMBER>85072
140515762283216 -><PHONE_NUMBER>85072
140515762285072 -><PHONE_NUMBER>84624
140515762285776 [label=x0(2, 2) float64, color=orange, style=filled]
140515762283216 [label=x1(2, 2) float64, color=orange, style=filled]
}

but I got this error, syntax error in line 2 near '('.
I want to more string labeling in dot graph node, but dot can't run code including : or ( or ) in label argument.
Can I solve this error?

Oh I resolved it. I add double quotation marks "" to label argument name. 🥲

@young-hun-jo Happy to hear you've got this sorted out already! It looks like you may have wanted to check and/or report this upstream to the GraphViz community/project :+1:
This project here provides a binding between GraPHP and GraphViz, it doesn't implement GraphViz.


Require this package when minimum-stability is "stable" ?

Hello,
Because of "stable" minimum-stability, I'm not able to require portphp/portphp.
[InvalidArgumentException]
  Could not find package portphp/portphp at any version for your minimum-stability (stable). Check the package spelling or your minimum-stability

I tried changing to "dev" and require works fine. But for our project, "dev" minimum-stability is not allowed in production environment.
Do you know a workaround to require a stable version of portphp/portphp ?
Thanks by advance,
Bastien.

Hi, how about in composer.json:
{
    "minimum-stability": "dev",
    "prefer-stable": true
}

Hi @aistis- ,
I am not allowed to change the minimum stability because it's part of a bigger project.
I was able to require it though, by manually writing in composer.json and running composer install. No stability warning (which is weird IMO).

Simply put: "portphp/portphp": "^1.0@dev" instead of "portphp/portphp": "^1.0" in your composer.json .
This will change the minimum-stability for this package only.

Thanks I'll try that (not at work right now)

I just released portphp/portphp 1.0.0.


app tries to claim rewards, shows error on startup

"reward is limited to 1 per person"
Akin said we are checking the existing reward list, but there may be a timing issue.

If errors, don't show popup.


[WFLY-6607]: Broadcast/Discovery group is possible to create with just a name.

 * [WFLY-11005]: Requires connectors for broadcast-group resource.
 * Making jgroups-cluster and socket-bindings required for DiscoveryGroups and BroadcasrGroups.
 * Fixing migration

Requires https://github.com/wildfly/wildfly/pull/11678
Jira: https://issues.jboss.org/browse/WFLY-6607
Jira: https://issues.jboss.org/browse/WFLY-11005

@ehsavoie The problem with the current broadcast/discovery group resources is they have ambiguous requirement specifications.  Really, they each need to be split into 2 different resources.  This is the goal of https://issues.jboss.org/browse/WFLY-10339.
I don't think you can/should make the jgroups-cluster and socket-bindings required as these are mutually exclusive attributes.

@pferraro being required but also alternatives means that only one has to be defined thus I don't see how that would block WFLY-10339 transformation since I expect those resources either to have socket-binding or jgroups-cluster. But maybe we should focus on WFLY-10339 before doing this one

being required but also alternatives means that only one has to be defined
Ok, that's good to know. In that case, there's no issue, but given that I'm planning to address WFLY-10339 for WF15, this PR should be made redundant soon.

@ehsavoie @pferraro Adding the hold label after skimming the discussion. If I am wrong please let me know

@ehsavoie @jmesnil Early in WF 17 work lets either close this or rebase it and do anything needed to get the 'hold' label removed.

This should be closed as we discussed it during the f2f. I'll keep it until WF16 is out

I'm closing this based on the comments. If I'm understanding this incorrectly please rebase and reopen.


required-features doesn't work with non-top-level features

When adding the following to Cargo.toml
[[test]]
name = "tests"
path = "tests/test.rs"
required-features = ["diesel/postgres", "diesel/sqlite"]

I'd expect that cargo test --features "diesel/postgres diesel/sqlite" would run the tests. Instead, it makes it impossible to run them. That command runs the tests (and enables the features) properly when the required-features line is removed.
As an aside, the documentation is unclear as to whether required-features enables those features for a given target, or whether it skips it when those features aren't enabled.

cc @jbendig, mind taking a look?

I'll take a look at this. I should have time later this afternoon.

Thanks @jbendig! Lemme know though if it takes up too much time and I can take over

I've been able to reproduce this issue. It's because dependency based features are being resolved before being checked against required-features. If you pass --features "diesel/postgres diesel/sqlite", then required-features will only see the "diesel" feature as enabled.
This is easy enough to fix with respect to the --features flag but I think there is a deeper problem here. For example, the following should build foo without the --features flag because the "bar/a" feature is enabled:
[dependencies]
bar = { path = "bar", features = ["a"] }

[[bin]]
name = "foo"
required-features = ["bar/a"]

I'm still investigating the best way to approach this.
Regarding the documentation, I can see where the text is not clear as it should be. I'll try to change it after this issue is fixed.

@sgrif This should be fixed in the newest nightly. Can you please see if it work for you? If not, I'd be happy to take another look.

Sure, I'll take a look tomorrow

Any news on this one - does it work as expected now ?

I think so. Should required-features for [[test]] apply to examples as well?

@sgrif hm can you clarify? What do you mean about tests applying to examples?

If I have the entry in my Cargo.toml listed in the original issue, and I run cargo test, it will still fail because there are files in examples which need those features to compile as well.

Does adding required-features to the [[example]] sections work?

Yes, but that would require one entry per-example file, requiring me to list every example explicitly in Cargo.toml which wasn't otherwise required.

Indeed it would! That's covered by https://github.com/rust-lang/cargo/issues/4013, so I'm going to close this now


[Bug]: Unable to view secrets in netbox web ui (3.5.4 / 1.8.3 + 1.8.5)

NetBox Secrets plugin version
v1.8.3 / v1.8.5
NetBox version
v3.5.4
Steps to Reproduce
Upgraded netbox from 3.4.10 to 3.5.4. Upgrade completed normally. Indicated version of netbox-secrets is v1.8.3. I've manually installed from the downloaded v1.8.5 release as well, but that still indicates v1.8.3 and appears to have the same issue.
After upgrade, attempting to a view a secret via the web UI fails.
After clicking "unlock secret" the "Enter Private RSA Key" prompt is shown, and the correct key is accepted (green toaster popup: " Session Key Received / You may now unlock secrets."). The secret is not revealed. Clicking the "unlock secrets" button again triggers another prompt for entering the private key.
As far as I can tell, API access to keys is working normally outside the netbox web interface.
Expected Behavior
I expect the secret to be shown after the correct private key is provided.
Observed Behavior
The secret is never shown, and the "enter private rsa key" dialog is shown repeatedly.

Make sure you have properly run collectstatic command and cleared the browser cache including the cookies. This seems like your static files aren't updated and are still referencing the old one from v3.4.10.
You can also use collectstatic --clear to ensure old files are removed first before collecting the new ones.

Clearing and repopulating the static files had no effect, the behavior was the same. Clearing the browser cache has resolved the issue.


Normalization of package names according to PEP503

          I go a little bit deeper, and figure out that PEP503 is obligate to normalize names of packages and replace all `-`,`.` and `_` with `-`.

LInk: https://peps.python.org/pep-0503/#normalized-names
As far as it is required renaming and releasing new package, and can lead for inconsistency, I've decided to separate this activity with the new task.
Originally posted by @kse3hi in https://github.com/eclipse-velocitas/devenv-devcontainer-setup/pull/51#discussion_r1483502053

@kse3hi: What actually needs to be done here? All our repos already follow that pattern (just lowercase letters + '-') ...


MQTT '+' wildcard subscriptions

I haven't been able to get subscriptions to work with the '+' wildcard (matches all topics at the same level in the hierarchy).  The '#' wildcard (matches topics at a level and all subtopics) is working fine.
I ran into a bug with the Apache Camel MQTT component on this as well, where the topic subscription strings were getting URL encoded/decoded, and the '+' was getting converted to a space.  I just wanted to mention this in case it's the same problem.

Hi mmindenhall,
thanks for your feedback. I quickly checked and foo/+ works fine, but using multiple level of + like SENSOR/+/TEMP indeed does not work. I will look into this after updating MQTTLens to Polymer 0.5.5 and successfully publishing to the Google Chrome Store.

Thanks!  I was trying with something similar to the following: BASE/+/data/#.  The + matches all devices, and /data/# is the hierarchy of topics that devices are publishing to.

I expect to push an update on Sunday

Hi mmindenhall,
it took me a little more effort to get 0.0.4 done. I just pushed Pre-release 0.0.5 18b3a6d752ba6b6346b8f52d999a37d781fc3143 and attached MQTTLens_0.0.5-SNAPSHOT.zip that solves the wildcard subscription issue


Make 10 rows/page default and expand height of TableChart

Closes #578

I think we should check with Chi / perhaps run this by a wider audience, as it looks pretty odd to have just this one card be significantly longs than the others.. could you start the conversation on this in slack?

This looks ok to me and is better than the alternative of hiding several rows. We can run it by the group during the meeting today


Dataobject question

Hello,
Would you be open to using something like Project Lombok in the dataobjects to cut down on the getters and setters? For example #67 is hundreds of lines of boiler plate code. Project lombok could cut that down to under 100 lines.. Just thought Id ask before I did any work on it..

appologies for the late response.
My inclination is no.

We use something similar for jpa here (as well as having toyed with
lombok previously) and our experience is that the tooling tends to get
in the way.
But what do other people think about Lombok?
Brett
On 07/07/15 19:07, Michael Rice wrote:

Hello,
Would you be open to using something like Project Lombok
https://projectlombok.org/download.html in the dataobjects to cut down
on the getters and setters? For example #67
https://github.com/asterisk-java/asterisk-java/pull/67 is hundreds of
lines of boiler plate code. Project lombok could cut that down to under
100 lines.. Just thought Id ask before I did any work on it..
—
Reply to this email directly or view it on GitHub
https://github.com/asterisk-java/asterisk-java/issues/68.

--
S. Brett Sutton
Ph: 1300 NOOJEE (1300 666 533)
Noojee Telephony Solutions - On Demand Contact Centres Solutions
www.noojee.com.au

Will close as I've not had any ground swell of support for the idea.


allow using md-form-field within dynamic components

Bug, feature request, or proposal:
proposal
What is the expected behavior?
I want to create a wrapper component with md-form-field which render a dynamic component that render and (input, checkbox ...).
    <md-form-field>
      <ng-template #fieldComponent></ng-template> // will render a component with `<input mdInput />` for example
    </md-form-field>

What is the current behavior?
An exception is raised Error: md-form-field must contain a MdFormFieldControl.
What are the steps to reproduce?
Providing a Plunker (or similar) is the best way to get the team to see your issue.
Plunker template: https://goo.gl/DlHd6U
What is the use-case or motivation for changing an existing behavior?
Which versions of Angular, Material, OS, TypeScript, browsers are affected?
Is there anything else we should know?

Any update on the above feature or request?


Creating a new Azure Functions app does not use the latest runtime

Creating a new Azure Functions app does not use the latest runtime
Repro steps

Login to https://portal.azure.com
Ensure you have an App Service Plan in West Europe on F1 Free Tier
Create a new Function App using the App Service Plan with a new Resource Group and Storage Account
Wait for the Function App to be deployed
Go to the new Function App

Expected behavior
Function App deployed with the latest runtime version (~0.9 at time of writing)
Actual behavior
Shown message

A new version of Azure Functions is available. To upgrade visit Function App Settings. Learn more

Deployed with runtime version: ~0.8.
Known workarounds
The runtime version can be upgraded by going to Function App Settings; however this is an extra step required when creating the Function App from the UI
Related information
Confirmed on 14/11/2016 at 12:13 on a Pay as you Go account

This will be fixed shortly. However, you should use a Dynamic app service plan rather than a Free app service plan. The Dynamic plan has a generous free grant and all triggers are supported. On Free, only http triggers will work reliably.

@lindydonna good advice thank you.  If I choose a Dynamic plan (has this now been renamed to "Consumption Plan"?) will it use the latest runtime version?

Confirmed that the production environment now picks up the latest version (i.e. ~1).

@lukemerrett For your existing Function Apps, you can use the upgrade button on the settings page. Otherwise, new Function Apps will automatically pick up the latest version, as @paulbatum confirmed.


update versions

project-build-plugin to 8.0.4
project versions to 8.0.0-SNAPSHOT

https://jenkins.ivyteam.io/view/scrum-master/job/samples-ivy-extension-demos/job/updateVersions/


Scaleable Divisor.

Im not a java programmer but i did take a crack at trying to get this to work ...
this guage in its current configuration is really only good for values 0 to 100 however it could be made much more useful for values over 100 if there was a settable property called a "divisor" basically it would take this line of code:
tail = head + (distance * value) / 100;
and replace it with this:
tail = head + (distance * value) / divisor;
i have tried to do this but i have no idea how to pass a variable from the browser to the java script, i have however been able to reverse engineer this to some extent to be updated via php. yay me...
i have attached the modified file, maybe it did it right maybe i did it wrong (more than likely) either way i cant get it to work .
angularjs-gauge1.zip
obviously this would be good if you have any value over 100, for example and in my case in the arduino community we oftern measure tempuratures or rpms that are far higher than 100, and in that case we could map it to a value of percentage but then we wouldnt be able to see the actual value in the center of the gauge. with a divisor we would be able to scale the results, as long as the starting point is 0 the divisor would be the maximum value.
i have done this manually in the code and it didnt effect the functionality it actually does it quite well however i cant figure out how to use different instances of the script either or i would have just hardcoded 4 different versions of the script.
then again this feature could be the feature that sets yours apart from the rest. i was drawn to this because of the simplicity and with a simple command i could make it work with php.
example:
<?php                      echo "<ng-gauge type=\"{{'arch'}}\" divisor=\"100\" size=\"{{'150'}}\" thick=\"{{'3'}}\" label=\"{{'Alt. 1'}}\" append=\"{{''}}\"                     prepend=\"{{''}}\" cap=\"{{'round'}}\" foreground-color=\"{{'rgba(147, 0, 14, 1)'}}\"                     background-color=\"{{'rgba(89, 89, 89, 1)'}}\" value=\"".$row['ATach1']."\"></ng-gauge>";                      ?>

Hi @tbillion,
You reverse engineered it correctly. It may not be working because of some mathematical equation.
Anyways, the use case that you have is to show value greater than 100. So for that do not use value attribute. Use used and total attributes. Why? You are right, value attribute only supports value between 0-100. used and total attribute will show the actual value of used on label, but gauge will be created as the percentage of used out of total.
For example:
<ng-gauge   used="156" total="500"
thick="10" type="arch" append="rpm"
 foreground-color="rgba(147, 0, 14, 1)" background-color="rgba(89, 89, 89, 1)">
</ng-gauge>

For now, this will help you with your usecase. Just figure out what could be the maximum value rpm can get use that as total and the value that your platform returning for current time is sent to used attribute. It is also mentioned on the documentation here
And i very well got your point of making angular-gauge more usable for larger audience like for your usecase. Even i received similar pull requests few days back for same thing to support negative usecase using negateValue, displayValue etc. But the problem is i do not want to introduce custom attributes like negateValue, displayValue, divisor etc. I want to make it more general that can serve as many usecases as possible. But, yes you idea really helped in figuring out the mathematical equation in more depth.
So in next major release v2.0 i will introduce min, max and value attribute which can handle 0-100 case, greater than 100 use case as well as negative use case.  And from API wise it will become more closer to HTML5 <meter> element MDN.
So try to use it the way i mentioned, do take an upgrade to 2.0 once it is available in few days.
Let me know, if it works.
Ashish

@tbillion  this issue has been addressed in v2.0.0. You may take an upgrade.


Generate index

Docs Build status updates of commit 2927981:
:warning: Validation status: warnings

File
Status
Preview URL
Details

rd/index.yml
:warning:Warning

Details

rd/map.yml
:warning:Warning

Details

rd/alex-mang.yml
:white_check_mark:Succeeded

rd/media/profiles/alex-mang.jpg
:white_check_mark:Succeeded

rd/toc.yml
:white_check_mark:Succeeded

rd/index.yml

Line 0: [Warning] Invalid file link:(~/about).
Line 0: [Warning] Invalid file link:(~/CodeOfConduct).
Line 0: [Warning] Invalid file link:(~/map).

rd/map.yml

Line 0: [Warning] Invalid file link:(~/about).
Line 0: [Warning] Invalid file link:(~/CodeOfConduct).
Line 0: [Warning] Invalid file link:(~/map).

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


digits setup runtime

Hi,
I read my passwort from mysql and legths are always differently.
can you please say me , how i can setup the Digits on runtime?
thanks
e.kaplan

currently library does not support runtime configuration of digit length. Will add that feature and update soon.
thanks

ok bro, i will thank you if you add this feature next update (1x star and add your project in my watched list)

New version(1.1.0) released with above required feature. Check 'README` for details.

how must it define in XML?
i defined so;
>         <in.arjsna.passcodeview.PassCodeView
                android:id="@+id/pass_code_view"
                android:layout_width="match_parent"
                android:layout_height="match_parent"
                app:digit_size="30.0dp"
                app:key_text_size="30.0sp"
                android:padding="25.0dp"
                app:empty_drawable="@drawable/empty_dot"
                app:filled_drawable="@drawable/filled_dot"/>

but it show alway 4 digit.
My Code is;
   PASSCODE =  "123456";

        TextView promptView = (TextView) findViewById(R.id.promptview);
        Typeface typeFace = Typeface.createFromAsset(getAssets(), "fonts/Font-Bold.ttf");

        passCodeView = (PassCodeView) findViewById(R.id.pass_code_view);
        assert passCodeView != null;
        passCodeView.setKeyTextSize(50f);

        passCodeView.setDigitLength(PASSCODE.length());
        //passCodeView.setDigitLength(8);
        passCodeView.setTypeFace(typeFace);
        passCodeView.setKeyTextColor(R.color.black_shade);
        assert promptView != null;
        promptView.setTypeface(typeFace);

ok ok..  everythings is ok...Rebuild Project and its working on runtime :-)


Selector dots for deleting/download an installed theme in dark mode are the wrong shade

Issue Summary
If you want to delete and/or download an installed theme it would appear that you can't, but that's only because the three dots signifying the button for doing the aforementioned are the wrong shade and so are "invisible" (until you hover over them).

Somewhat noticeable when hovering:

Steps to Reproduce

Turn on dark mode
Navigate to the Installed themes section
See the missing three dots for downloading/deleting an installed theme

Ghost Version
5.71.2+moya
Node.js Version
Yes
How did you install Ghost?
Ghost(Pro)
Database type
MySQL 5.7
Browser & OS version
Firefox 119, macOS 13.6
Relevant log / error output
No response
Code of Conduct

[X] I agree to be friendly and polite to people in this repository

I see that as of 5.72.1 this is now working fine. Thank you.

Closing, as this issue has been fixed for some time now.


Added visited/captured (anti?)highlighters

I've seen a few requests now to hide visited/captured portals so added highlighters to do that. I think these should more appropriately be layers, but haven't been able to figure out a good way to do so.

I have a pull request in the queue which adds layers for the visited and captured portals.
https://github.com/jonatkins/ingress-intel-total-conversion/pull/916

@Beakerboy Hot diggity u da man!


Fixed wrong assert in evaluation.py

The previous code would throw an error if results["tnr"] + results["fpr"] = 0.
This can happen if for a sensitive attribute a class has only a few values, and then both tnr and fpr are 0.

Thanks for the bug report!
You're right, it can happen that both TNR and FPR are 0 due to safe_division returning 0 when the denominator is 0.
This probably needs to be fixed in other places as well.


Write a generator to generate common.Getter from a struct

Otherwise it is almost copy/paste and we want to generate getter in order to avoid using reflection

Addressed by https://github.com/skydive-project/skydive/pull/1783


QC file mostly showing zeros.

Hi Rongxin,
I run the following snap-pre command on a bam file, and got the following QC file with mostly 0s. Is there anything wrong with the bam format that I'm using?
snaptools snap-pre  \
  --input-file=heart.03.rep1.bc.bam  \
  --output-snap=heart.03.rep1.bc.snap  \
  --genome-name=mm10  \
  --genome-size=mm10.chrom.sizes  \
  --min-mapq=30  \
  --min-flen=0  \
  --max-flen=1000  \
  --keep-chrm=TRUE  \
  --keep-single=TRUE  \
  --keep-secondary=False  \
  --overwrite=True  \
  --min-cov=100  \
  --verbose=True

Total number of unique barcodes:             14408
TN - Total number of fragments:              0
UM - Total number of uniquely mapped:        0
SE - Total number of single ends:            0
SA - Total number of secondary alignments:   0
PE - Total number of paired ends:            0
PP - Total number of proper paired:          0
PL - Total number of proper frag len:        0
US - Total number of usable fragments:       0
UQ - Total number of unique fragments:       0
CM - Total number of chrM fragments:         0

can you show me the first file lines of your bam file?

Here it is. Thanks for looking into it for me.
@HD     VN:1.0  SO:queryname
@SQ     SN:chr10        LN:130694993
@SQ     SN:chr11        LN:122082543
@SQ     SN:chr12        LN:120129022
@SQ     SN:chr13        LN:120421639
@SQ     SN:chr14        LN:124902244
@SQ     SN:chr15        LN:104043685
@SQ     SN:chr16        LN:98207768
@SQ     SN:chr17        LN:94987271
@SQ     SN:chr18        LN:90702639
@SQ     SN:chr19        LN:61431566
@SQ     SN:chr1 LN:195471971
@SQ     SN:chr2 LN:182113224
@SQ     SN:chr3 LN:160039680
@SQ     SN:chr4 LN:156508116
@SQ     SN:chr5 LN:151834684
@SQ     SN:chr6 LN:149736546
@SQ     SN:chr7 LN:145441459
@SQ     SN:chr8 LN:129401213
@SQ     SN:chr9 LN:124595110
@SQ     SN:chrM LN:16299
@SQ     SN:chrX LN:171031299
@SQ     SN:chrY LN:91744698
@PG     ID:bowtie2      PN:bowtie2      CL:"/opt/biotools/bowtie2/bin/bowtie2-align-s --wrapper basic-0 -x /home/opoirion/data/ref_genomes/mouse/mm10/Bowtie2Index/mm10 -p 8 -S /oasis/tscc/scratch/opoirion//hearth_3_months//repl1//tmp.repl1_hearth_3_months.bowtie2.sam -1 /tmp/46226.inpipe1 -2 /tmp/46226.inpipe2"      VN:2.2.7
03.rep1.AAACTACCAGAAACCCGAGATA:NB501692:72:HGK5FBGX7:1:11101:1678:4293  81      chr8    105601397 0       6M1I43M =       105601403       55      GAGACAGGCTCAAAGGCCAGTGCCTGGCAGAAGATGTGCCCAGGAACTGC        EEEEEEEEEEEEEEEEEEEE/EEEEEEEEEEEEEEEEEEEEEEEEAAAAA      AS:i:-28 XN:i:0   XM:i:4  XO:i:1  XG:i:1  NM:i:5  MD:Z:1C0T0T44A0 YS:i:-18        YT:Z:DP BX:Z:03.rep1.AAACTACCAGAAACCCGAGATA
03.rep1.AAACTACCAGAAACCCGAGATA:NB501692:72:HGK5FBGX7:1:11101:1678:4293  161     chr8    105601403 0       42M1I7M =       105601397       -55     GCTCAAAGGCCAGTGCCTGGCAGAAGATGTGCCCAGGAACTGCCTGTCTC        AAAAAEEE/EEEEEEEEEEAEEEEEEEE<EEEEEEEEEEEEAEEEAEEEE      AS:i:-18 XN:i:0   XM:i:2  XO:i:1  XG:i:1  NM:i:3  MD:Z:42A5G0     YS:i:-28        YT:Z:DP BX:Z:03.rep1.AAACTACCAGAAACCCGAGATA
03.rep1.AAACTACCAGAAACCCGAGATA:NB501692:72:HGK5FBGX7:1:11101:17639:12319        99      chr8      110674216       42      50M     =       110674455       289     GGCCTGGGGAGACCCAGGTGTCTGTCCTCTGGATCCTCAGCCAAGGGTCA        AAAAAEEAEEEEEEEAEEEEEEEEEEEEEEEEEEEAEEEEEEEEEEEEEEAS:i:0  XN:i:0  XM:i:0  XO:i:0  XG:i:0  NM:i:0  MD:Z:50 YS:i:0  YT:Z:CP BX:Z:03.rep1.AAACTACCAGAAACCCGAGATA

if you run snaptools pre on demo example, do you also get the same problem?

I'll give it a try and let you know how it works.
On Tue, Mar 5, 2019 at 1:26 PM Rongxin Fang<EMAIL_ADDRESS>wrote:

if you run snaptools pre on demo example, do you also get the same problem?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/r3fang/SnapTools/issues/2#issuecomment-469863605, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AFOG6JQ0jIRDoAbl-EwrIZ-wfWT_QUIUks5vTuD-gaJpZM4bfSCt
.

--
Yanxiao Zhang
Postdoctoral fellow,
Ludwig Institute for Cancer Research,
University of California,
San Diego, CA, 92093

The demo works. Then it must be something specific about the bam file.
Btw, the bam is generated by bowtie2 I think (from Olivier, but I added sample specific barcode), is this where the problem is?

Total number of unique barcodes:             3217
TN - Total number of fragments:              576676
UM - Total number of uniquely mapped:        540304
SE - Total number of single ends:            0
SA - Total number of secondary alignments:   1
PE - Total number of paired ends:            540303
PP - Total number of proper paired:          539783
PL - Total number of proper frag len:        539783
US - Total number of usable fragments:       539783
UQ - Total number of unique fragments:       537347
CM - Total number of chrM fragments:         0

it works for bowtie generated bam file, I don't think that's the problem. My suggestion is to change the barcode from "03.rep1.AAACTACCAGAAACCCGAGATA" to "AAACTACCAGAAACCCGAGATA.03.rep1", to avoid barcoding starting with number. You can test this with only a few thousand cells. If this is still not working, maybe try not to change the original barcode and try it againn. if it is still not working, then it should be something wrong with bam file

Yes, I removed the numbers and it worked.
Are you planning to make it work with barcodes starting with numbers? Just curious. If not, I guess you can add a note/warning for the users like me who may use numerical barcodes.

will add a note. Actually, this problem is caused by pysam which does not recognize read name starting from number. I guess this should be a general requirement by htslib for all fastq files.

I see. I will modify my barcode accordingly. Thanks!


Fix code scanning alert - Log entries created from user input

Tracking issue for:

[ ] https://github.com/andrrff/BugSearch/security/code-scanning/5

commit 6b84aff


Still has ELE courses and course requirements

TigerPath still has ELE course information and course requirements instead of ECE course requirements, which makes it impossible to statisfy all of the requirements of Electrical and Computer Engineering.

Please revise this! :)


notifyDataSetChanged() Does not work

Hi there
There is a issue with this adapter, I've to get categories and their subcategories from rest API.
As usual after parsing and making my List and assign that to Adapter, I use notifyDatasetChanged() method to notify Adapter.
Issue is there! Adapter does not recognize the change!
another odd action: notifyDatasetChanged() close the open parent but the arrow still remain in it's open state! ( When I populated the adapter with fake data like yours sample app ).
Is there any custom method for this?

Correct, notifyDataSetChanged will rebuild the list using the underlying data set. However, in the expandable recycler view, the underlying data set is the flattened list of items. You would need to rebuild this list by calling setItems which will then call notifyDataSetChanged for you. Note that incrementally adding or removing items is not supported because I didn't need it. Contributions welcome!

Hi there, Thanks for your prompt response.
Another question is, How can get position of selected child?
visibleItems.get(position).ROW_TITLE
I want to show selected state to user, then I have a SparseBooleanArray to map selected position to Boolean to change child background to selected.
But! when user select one child from a parent, open another parent! child from late parent may be selected!!! o_O
How you resolved this issue?

You can get the index in the array of all items given the index of the item position:
int allItemsPosition = indexList.get(visiblePosition);


BigMart Sales Prediction

I want to contribute to this repo. Please assign me this task as soon as possible!
Thankyou.

I would like to work on this issue. Please assign me.

I  want to contribute on this issue please assign it to me under gssoc24

I want to contribute on this issue please assign it to me under gssoc24

Hello!
I'm really excited about the project and would love to be a part of it. Drawing from my experience with similar projects in the past, I'm confident that I can bring valuable insights and contribute effectively. If possible, I'd appreciate being assigned to the project. Looking forward to your response. Thank you!

I want to work on this project. Can you assign this task to me?

Hello, I am a GSSOC participant. I want to work on this issue!

Hello
I am a contributor of GSSoC'24
I've good understanding on ML
Kindly assign me this issue. I'd like to contribute

Hello, I am a contributor of GSSOC24, would love to contribute. I have previous knowledge regarding ML model trainings.

Hi I would like to contribute to this issue under gssoc 24 as a contributor

Hi @pratishthaa  I want to work on this issue , please assign me this issue .

Hi I would like to work on this issue, please assign it to me

Hello @pratishthaa I am a GsSOC'24 contributor and I would like to work on this issue. Can you please assign it to me?

Hi @pratishthaa  I am a GSSoC24 contributor and I would like to work on this issue. I have done a similar project of sales analysis of an electronics shop. So I think i can do this. Please assign this issue to me


Main builds fail with error: symbol init___rust_ctor___ctor is already defined

Describe the bug
https://github.com/apache/arrow-datafusion/actions/runs/5125505760/jobs/9218772590
Fails with

error: symbol `init___rust_ctor___ctor` is already defined
   --> datafusion/optimizer/src/scalar_subquery_to_join.rs:311:5
    |
311 |     #[ctor::ctor]
    |     ^^^^^^^^^^^^^
    |
    = note: this error originates in the attribute macro `ctor::ctor` (in Nightly builds, run with -Z macro-backtrace for more info)

error: could not compile `datafusion-optimizer` due to previous error

To Reproduce
If you run cargo update
    Updating ctor v0.2.0 -> v0.2.1

Then the link error will happen
It appears this crate was released about the same time as our CI started failing: https://crates.io/crates/ctor/0.2.1
Expected behavior
No response
Additional context
No response

I filed https://github.com/mmastrac/rust-ctor/issues/283 upstream

I am facing the same problem.
If you have already performed a cargo update, you can fix this issue by running the command:
cargo update -p ctor --precise v0.2.0

Proposed fix: https://github.com/apache/arrow-datafusion/pull/6505/files

ctor 0.2.2 is pushed without #[no_mangle]. Please let me know if this fixes it.

Thanks @mmastrac  -- we have found a workaround.


feat: Item components

Feature
Basic implementation that allows extending ESCItem without touching the core.
We pass custom_data to the components by reference so components can have persistend data.
For now there is a super basic autoload for components... but i think, in the future,  it should be done with an item_component_manager to check for name collisions and automatic initialization for the components without extending ESCItem.
With this implementation we are composing all our ESCItem customizations.
How to test

Open the demo game. Everything should work as always without errors in the log.

Thanks for this. I do have some thoughts/questions, though, that maybe you can help clarify:
I'm not exactly clear on the benefit of adding this in.
Given that the components don't depend at all on the parent (other than an optional Dictionary), you could either:

Simply add in components to your specific ESCItem since there's no real dependency; or,
Extend ESCItem when you create your own item scene and add in any registration functionality you may need (similar to what's in this PR).

If the issue is persistence, you can also use the second option above and pass on any already-persisted custom_data, which I believe you submitted a PR for a little while ago.
@StraToN what do you think? Am I missing something? Is this a feature that you think a lot of people would need?

@StraToN what do you think? Am I missing something? Is this a feature that you think a lot of people would need?

I agree, I am also a bit dubitative on this one. @oierbravo could you please give us some more precision on the feature, and propose a few specific use cases. Is this different from the other PR your submitted a few weeks ago?
Also, does this change anything on the matter of save games?

Hi!
We are trying to not extends the core ESCItem (and ESCPlayer) and trying to keep the core intact(kind of a blackbox).
This feature extends the other PR... it should be compatible with savegame as far as the ESCItem  is.
I'm writing a little doc to explain everything with some examples😄.
Thanks for the super quick response and the care and attention to detail you put in this proyect😍


How to config aws client???

I install completely ec2-api and aws-cli
I create a credentials:
$ openstack ec2 credentials create
+------------+-----------------------------------------------------------------------------------------------------------------+
| Field      | Value                                                                                |
+------------+-----------------------------------------------------------------------------------------------------------------+
| access     | cbcbbe41d2334d1bad1fb64c4346ef91                                                                         |
| links      | {u'self': u'http://controller:35357/v3/users/269873889f7a407f84288625c132df34/credentials/OS-EC2/cbcbbe41d2334d1bad1fb64c4346ef91'} |
| project_id | 12af82f32b4b49d6a1550effdb7f683e                                                                           |
| secret     | 13d23317d01e4a8dbc46d9e95143c0d7                                                                        |
| trust_id   | None                                                                                |
| user_id    | 269873889f7a407f84288625c132df34                                                                          |
+------------+-----------------------------------------------------------------------------------------------------------------+
And then i need configure aws:
$ aws configure
AWS Access Key ID [None]: cbcbbe41d2334d1bad1fb64c4346ef91
AWS Secret Access Key [None]: 13d23317d01e4a8dbc46d9e95143c0d7
Default region name [None]: us-west-2
Default output format [None]: json
which "Default region name" should I configure?
When check operator:
$ aws --endpoint-url http://controller:8788 ec2 describe-instances
An error occurred (AuthFailure) when calling the DescribeInstances operation: Not Found
@hieulq Can you give me a tutorial or doc which has more detail about configuration aws-cli???

the default region name is RegionOne
On Thursday, 25 August 2016, nhatbkk57<EMAIL_ADDRESS>wrote:

Assigned #35 https://github.com/cloudcomputinghust/CAL/issues/35 to
@hieulq https://github.com/hieulq.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/cloudcomputinghust/CAL/issues/35#event-767174600, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ABui7vMSVXhE37SkTlE6gHE-_s6BvxRgks5qjWMugaJpZM4Js4E7
.

--
-----BEGIN GEEK CODE BLOCK-----
Version: 3.1
GCS/CM/IT/M/MU d-@? s+(++):+(++) !a C++++(++++)$ ULC++++(++)$ P L++(+++)$ E
!W N* o+ K w O- M V- PS+ PE++ Y+ PGP+ t 5 X R tv+ b+(++)>+++ DI- D+ G
e++(+++) h-- r(++)>+++ y-
------END GEEK CODE BLOCK------

@hieulq  still got same error. The ec2-api server response 404
2016-08-26 15:19:24.828 13727 INFO ec2api.api [-] 0.22196s <IP_ADDRESS> POST / None 404 [aws-cli/1.10.59 Python/2.7.6 Linux/3.16.0-77-generic botocore/1.4.49] application/x-www-form-urlencoded text/xml
2016-08-26 15:19:24.831 13727 INFO ec2api.wsgi.server [-] <IP_ADDRESS> "POST / HTTP/1.1" status: 404 len: 298 time: 0.0258241

@hieulq when i send request:
$ aws --endpoint-url http://controller:8788 ec2 describe-instances
keystone_access.log response:
<IP_ADDRESS> - - [26/Aug/2016:16:06:19 +0700] "POST /v3/v3/ec2tokens HTTP/1.1" 404 405 "-" "python-requests/2.11.1"
Can I fix "/v3/v3/ec2tokens" into "/v3/ec2tokens" and how?

hm, seems like this is the bug of ec2-api.
OK, bring it tomorrow and we will take a look.
On Fri, Aug 26, 2016 at 4:09 PM, nhatbkk57<EMAIL_ADDRESS>wrote:

@hieulq https://github.com/hieulq when i send request:
$ aws --endpoint-url http://controller:8788 ec2 describe-instances
keystone_access.log response:
<IP_ADDRESS> - - [26/Aug/2016:16:06:19 +0700] "POST /v3/v3/ec2tokens
HTTP/1.1" 404 405 "-" "python-requests/2.11.1"
Can I fix "/v3/v3/ec2tokens" into "/v3/ec2tokens" and how?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/cloudcomputinghust/CAL/issues/35#issuecomment-242674685,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABui7hDkHYLZp9v4v_YzWFas2HHR5vzBks5qjq1dgaJpZM4Js4E7
.

--
-----BEGIN GEEK CODE BLOCK-----
Version: 3.1
GCS/CM/IT/M/MU d-@? s+(++):+(++) !a C++++(++++)$ ULC++++(++)$ P L++(+++)$ E
!W N* o+ K w O- M V- PS+ PE++ Y+ PGP+ t 5 X R tv+ b+(++)>+++ DI- D+ G
e++(+++) h-- r(++)>+++ y-
------END GEEK CODE BLOCK------

I installed ec2-api with devstack, that seem successful and saw something different from manual installation. For example, in devstack installation, i saw ec2, s3, ec2-metadata was created a service endpoint but manual installation not ...
I think that installation docs of ec2-api is not complete.

@nhatbkk57 yeah, the doc of ALL openstack projects seem like a mess..


[NcTools] Add version info to asset files

The nc-convert version should be written in asset files so we can verify the layout/format is supported when importing them.

completed


remove std::process::exit calls in json-rpc service

What was wrong?
Fixes #389
How was it fixed?
To-Do

[ ] Add entry to the release notes (may forgo for trivial changes)
[ ] Clean up commit history

@jacobkaufmann It seems safe to close this now that we no longer maintain our own jsonrpc service?