Use existing end extraction model on new dataset?

I've worked through the intro tutorials and produced an end extraction model that I like. Is there a way to run another dataset through this model? (Ideally, in a separate notebook). Or would it make more sense to train another model on the other dataset using the same candidate extractors and labeling functions as the first one?

Hi @gabcbrown,
If you want to reuse a model, disc_model, for predictions, you can use the disc_model.save method to save to disk.  Then, reconstruct the model in the new notebook and call disc_model.load!
However: though this works for logistic regression, there are potentially some issues with other models like the LSTM in contrib / the CDR tutorial.  We're about to pull in a big refactor ( #681 ) that will fix this though, so stay tuned there!
As for whether you should retrain the model on the new dataset- this really depends on the similarity of the new dataset with the one you used for training your model.  There's a rich literature about all this sort of "transfer learning" stuff, but I would start by trying out the above--just using your already trained model to make predictions--and then if performance on the new set if much lower than on the original dataset, I'd try retraining on the new dataset instead

Let us say I have a model trained on historical data and I am satisfied with its performance. As a next step we want to aggregate one day's worth of text data and pass it through snorkel (parsing, candiate extraction, etc) and use the saved model to predict on the candidates extracted. Is it possible to this, or do we have to load all the data at one go before we start the training process?

See the answer above: you can reload the model using the load function!

When I tried saving and loading the model from the intro tutorial I got an error:
AttributeError: 'SparseLogisticRegression' object has no attribute 'k'
Do you know what went wrong there?

Sorry the saving / loading functionalities will be upgraded / fixed with
the v0.6 release due out end of this week! This particular change is
actually already fixed but just not yet merged to master, sorry for the
delay!
On Tue, Jun 27, 2017 at 9:00 AM JoMynta<EMAIL_ADDRESS>wrote:

When I tried saving and loading the model from the intro tutorial I got an
error:
AttributeError: 'SparseLogisticRegression' object has no attribute 'k'
Do you know what went wrong there?
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/HazyResearch/snorkel/issues/680#issuecomment-311404196,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABgw_TCAS5N7avWAgNr2GMvvZOGs5dUwks5sIScjgaJpZM4OCoHb
.

Should be fixed with v0.6; also in the intro tutorial now!

Can we use the existing model and load the model with .load() and train with a new train data set?
Can we directly use the model to give it a dump of documents to figure out the candidates or do we need to declare the candidate class and extract the possible candidates and then pass it that data to the model ?
Can we combine multiple models and generate a single model for all the candidate extraction from a set of documents text ? ( if every model should have the particular candidate class data passed as a paramater then this is not valid)

Re-opening this issue.
I am using Snorkel version 0.9.1 on a macbook pro version 10.14.6.
I created a LabelModel object and saved it:
label_model = LabelModel(cardinality=2, verbose=True)
label_model.fit(L_train=L_train, n_epochs=1000, lr=0.001, log_freq=100, seed=123)
label_model.save('./saved_label_model')

I then tried to load and use it on my test data:
testlm = LabelModel(verbose=False)
testlm.load('./saved_label_model')
testlm.score(L=L_test, Y=y_test)["accuracy"]

but got an AttributeError:
AttributeError: 'LabelModel' object has no attribute 'c_tree'

I also tried extracting the weights
testlm.get_weights()

but got another error
AttributeError: 'LabelModel' object has no attribute 'm'
Running .fit() on testlm, with the original data seemed to fix the problem:
testlm.fit(L_train=L_train, n_epochs=1000, lr=0.001, log_freq=100, seed=123)
However, this required having access to the original data. This is problematic if I want to reuse my model where I don't have access to those original data.
Since the code seems to be based on Pytorch, I also tried saving the state dictionary label_model.save('./saved_label_model_state_dict', label_model.state_dict()), but got another error TypeError: save() takes 2 positional arguments but 3 were given.
Could you then please tell me what to do after
testlm = LabelModel(verbose=False)
testlm.load('./saved_label_model')

so I can run testlm on my test data?
Thank you for your help.


Synthesis failed for Google.Cloud.GSuiteAddOns.V1

Hello! Autosynth couldn't regenerate Google.Cloud.GSuiteAddOns.V1. :broken_heart:
Please investigate and fix this issue within 5 business days.  While it remains broken,
this library cannot be updated with changes to the Google.Cloud.GSuiteAddOns.V1 API, and the library grows
stale.
See https://github.com/googleapis/synthtool/blob/master/autosynth/TroubleShooting.md
for trouble shooting tips.
Here's the output from running synth.py:
2021-03-19 22:43:48,934 autosynth [INFO] > logs will be written to: /tmpfs/src/logs/Google.Cloud.GSuiteAddOns.V1
2021-03-19 22:43:49,427 autosynth [DEBUG] > Running: git config --global core.excludesfile /home/kbuilder/.autosynth-gitignore
2021-03-19 22:43:49,430 autosynth [DEBUG] > Running: git config user.name yoshi-automation
2021-03-19 22:43:49,433 autosynth [DEBUG] > Running: git config user.email<EMAIL_ADDRESS>2021-03-19 22:43:49,436 autosynth [DEBUG] > Running: git config push.default simple
2021-03-19 22:43:49,439 autosynth [DEBUG] > Running: git branch -f autosynth-Google.Cloud.GSuiteAddOns.V1
2021-03-19 22:43:49,443 autosynth [DEBUG] > Running: git checkout autosynth-Google.Cloud.GSuiteAddOns.V1
Switched to branch 'autosynth-Google.Cloud.GSuiteAddOns.V1'
2021-03-19 22:43:49,631 autosynth [DEBUG] > Running: git rev-parse --show-toplevel
2021-03-19 22:43:49,637 autosynth [DEBUG] > Running: git log -1 --pretty=%H
2021-03-19 22:43:49,641 autosynth [DEBUG] > Running: git remote get-url origin
2021-03-19 22:43:49,675 synthtool [ERROR] > Failed executing git checkout master:

error: Your local changes to the following files would be overwritten by checkout:
	google/cloud/dialogflow/v2/answer_record.proto
	google/cloud/dialogflow/v2/conversation.proto
	google/cloud/dialogflow/v2/conversation_profile.proto
	google/cloud/dialogflow/v2/participant.proto
Please commit your changes or stash them before you switch branches.
Aborting

Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 354, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 189, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 312, in _inner_main
    git_source.enumerate_versions(sources, pathlib.Path(temp_dir))
  File "/tmpfs/src/github/synthtool/autosynth/git_source.py", line 202, in enumerate_versions
    source_versions = enumerate_versions_for_source(git_source, temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/git_source.py", line 166, in enumerate_versions_for_source
    local_repo_dir = str(synthtool_git.clone(remote))
  File "/tmpfs/src/github/synthtool/synthtool/sources/git.py", line 85, in clone
    shell.run(["git", "checkout", "master"], cwd=str(dest), check=True)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['git', 'checkout', 'master']' returned non-zero exit status 1.

Google internal developers can see the full log here.

Autosynth passed, closing! :green_heart:


Fix runtime and improve logger

This PR first fixes a mistake coming from a previous one. Then it makes the runtime more consistent by using logrus everywhere, instead of glog.

Coverage remained the same at 33.427% when pulling 84c785db9eb6b73e29f0557ba2107edbc5c10609 on sboeuf/fix_3_0 into 09a9599016b887ac4b291d6a82ba8ecbabb63f9c on master.

lgtm


[improvement](external catalog)Change log level to debug for getRowCountFromExternalSource.

Proposed changes
Issue Number: close #xxx

Further comments
If this is a relatively large or complex change, kick off the discussion at<EMAIL_ADDRESS>by explaining why you chose the solution you did and what alternatives you considered, etc...

run buildall


CSS Loading Problems

I am attempting to integrate LWC with Storybook at the moment, but I keep running into issues using LWC-specific styles. Initially, I had errors concerning css-loader trying to compile in the code from the associated LWC .css file. However, excluding the LWC path for css-loader did the trick. See here for more context: https://salesforce.stackexchange.com/a/360151
However, when I run storybook and the customized webpack, I get a similar runtime error:
TypeError: (0 , lwc__WEBPACK_IMPORTED_MODULE_0__.registerStylesheet) is not a function
	 at ./force-app/main/default/lwc/linkCard/linkCard.css

When I run the same configuration with just .HTML and .JS files in the LWC, everything works just fine. Looking into the linkCard.css file more, this is what the file gets rendered as:
linkCard.css
import { registerStylesheet } from 'lwc';
function stylesheet(token, useActualHostSelector, useNativeDirPseudoclass) {
  var shadowSelector = token ? ("[" + token + "]") : "";
  var hostSelector = token ? ("[" + token + "-host]") : "";
  var suffixToken = token ? ("-" + token) : "";
  return ".linkCard" + shadowSelector + " {display: flex;flex-direction: column;background-color: #fefefe;border-radius: 10px;box-shadow: 1px 1px 5px 5px rgb(0, 0, 0, .1);}.linkCard__link" + shadowSelector + ",.linkCard__link:link" + shadowSelector + ",.linkCard__link:visited" + shadowSelector + " {font-family: Georgia, 'Times New Roman', Times, serif;color: navy;font-size: 2.5rem;}.linkCard__description" + shadowSelector + " {font-family: 'Lucida Sans', 'Lucida Sans Regular', 'Lucida Grande', 'Lucida Sans Unicode', Geneva, Verdana, sans-serif;color: #222222;font-size: 1.2rem;}";
  /*LWC compiler v2.43.0*/
}
registerStylesheet(stylesheet);
export default [stylesheet];

Maybe this is some configuration I am missing, or something I am doing wrong, but it seems like the @lwc/compiler is causing this and I am wondering how I can get this CSS compiled and integrated into the component as its normal <style> tag before it is requested during runtime. I am opening this issue since I don't believe there is a way to do this currently with this plugin.

Hi, thanks for filing the issue. registerStylesheet was released in a recent version of LWC (https://github.com/salesforce/lwc/commit/c2265c92e2309063cb31118ca13cdffd254afaf7). Maybe in your dependencies, you have mixed versions of lwc? Are you using exactly the same version for your lwc dependency as well as your @lwc/* dependencies?
As for the linked StackExchange issue, yes, it's probably due to Webpack's css-loader, which does something totally different from the way LWC handles .css files (i.e. it injects <style>s into the <head>, whereas LWC emits the .css file as a JavaScript module with an exported function).

Hi Nolan, thank you very much for your response. After looking into this, I was pretty sure I had all my 'lwc' and<EMAIL_ADDRESS>packages up to date with the 2.44.0 release. However, after looking into package-lock.json more, I realized that there were some packages that caused some older versions of<EMAIL_ADDRESS>packages to be loaded into the webpack bundle instead. I went ahead and removed unused packages by running:
npm uninstall @salesforce/sfdx-lwc-jest  @lwc/eslint-plugin-lwc @lwc/engine

I am pretty sure that @salesforce/sfdx-lwc-jest was causing the issue in this case, since it uses older versions of @lwc/compiler, @lwc/engine-dom, etc... for its dependencies, but I can't confirm.
Thank you again, you are the best!


Replace gulp.watch() with the gulp-watch package

Fixes #46
- Summary
Currently you must stop the server/watcher and re-run to detect newly created files. This is cumbersome, and can be easily fixed by replacing the default gulp.watch() with the gulp-watch package (NPM).
- Test plan
npm install
npm run start

Terminal output before change == Terminal output after change
- Description for the changelog
gulp.watch() replaced with gulp-watch to detect new files

LGTM 👍 if in the future gulp is pulled this may be swapped with fs.watch() or its cousin fs.watchFile().

@chrisgeary92 trying to understand the scope of this to confirm this is needed. When you say,  "adding files", What type of files are you referring to?

Any new file, new template, partial etc.
If I were to run npm run start then create a new file at site/layouts/partials/header.html it's not recognised by gulp watch, so changes to this file do not trigger a rebuild.. You have to CTRL+C to quit watching, then run npm run start again so it can watch the new header file.
More information can be found here: https://stackoverflow.com/questions/22391527/gulps-gulp-watch-not-triggered-for-new-or-deleted-files

Thanks for the clarification and for the code for this. Made a note about fs.watchFile as well @jhabdas


give path to os.listdir()

in python 2 os.listdir() doesn't default to current directory. have a look

Give os.getcwd() as argument to os.llistdir().
os.getcwd() is equlient of pwd in terminal.

know of os.getcwd() approach. have used it at a couple of places. I was using for may be something like os.listdir(".") though it works on linux... don't know about windows


cmd: Permit deploying CO-RE flavor.

This commit adds the "--co-re" CLI flag to deploy the CO-RE flavor of Inspektor Gadget.
It cannot be used with "--image", as "--co-re" will use "latest-core". We also remove CAP_SYS_MODULE when using CO-RE flavor as this capability is not needed since we do not embed bcc gadgets.

@Preisschild @kim0 if you are interested in taking a look.

Hi, thanks. Would love to test.
Is there an image already available? I can't find it in the CI. I think it is expired.
Can I deploy it with kubectl gadget deploy --image <image>?

Seems to work. Image used is v0.19.0-core and SYS_MODULE is not included.

Yes


Adapters for Json.Serializer and Json.ReadOnlySerializer

I've noticed couple of things which could be a bit more kotlin-friendly when writing custom serializer.
IDEA auto-implements all serializer paramters nullabe. And the knownType  and type are of type Class<*>?. So, the auto-implemented serializer looks like this:
class MySerializer: Json.Serializer<MyClass> {
  override fun write(json: Json?, `object`: MyClass?, knownType: Class<*>?) {
  }

  override fun read(json: Json?, jsonData: JsonValue?, type: Class<*>?): MyClass {
  }
}

I analyzed the sources of com.badlogic.gdx.utils.Json and noticed that only the last parameter of both methods may be null. In all the other cases the serializer is simply not called, so that we can omit ?. Additionally the object parameter could be renamed to something that does not reqire quotes. And Class<*>? could be converted to KClass<*>? (this one requires new method). Basically the adapter may look like this:
abstract class KtxSerializer<T> : Json.Serializer<T> {
  final override fun write(json: Json, obj: T, knownType: Class<*>?) {
    // the same for the read method
    write(json, obj, knownType?.kotlin)
  }
  abstract fun write(json: Json, obj: T, knownType: KClass<*>?)
}

And the same can be done for com.badlogic.gdx.utils.Json.ReadOnlySerializer.
But generally I think it does not make much sense if not the Class<*>, as we could simply omit the question marks and rename the parameter. But if changing the type of the type and knownType parameters then why not do the others.
So, if that all makes sense, I can submit a PR. Though I'm not sure what to test here except the parameters that are passed to new methods (including conversion of Class to KClass).

Well, as it's sunday evening and I have nothing to do :smiley:, I can already submit the PR if this feature is relevant.

We've done something similar in ktx-app module, so we could improve LibGDX typing, although this might be more beneficial to add @NonNull/@Nullable annotations in LibGDX codebase.
Correct me if I'm wrong, as I haven't checked the sources yet, but is Json.Serializer something like a single function interface? Maybe we could choose a more Kotlin-like approach and instead of providing a class, we might add an (inlined) factory function, e.g.:
val mySerializer: Json.Serializer<Thing> = jsonSerializer<Thing> { json, obj, type ->
  // Your serialization code.
}

No, it's an interface with two functions read and write. Here is the exact code from libgdx sources:
static public interface Serializer<T> {
  public void write (Json json, T object, Class knownType);
  public T read (Json json, JsonValue jsonData, Class type);
}

And the Json object does not distingush serializers that are able to only read or only write. So, it won't be possible to write a function that creates a serializer  with only read or only write implementation, because Json maps serializer to a Class object, so we simply can't set two serializers for single class.

Well, you can have 2 lambda parameters, but I guess you're right that it would be less readable.
I'm pretty sure you can do abstract override fun on Java functions with ! types to specify the typing, you can check if you need to declare 2 function for write/read or if you can just define 2 abstract functions with the correct typing.

If I undestand you right, yes the ! types will work for sure. The main difference is the third parameter, in both methods: Class<*>. This is something that I'm not really sure and hope you may know.
If in any case it is not helpfull to have KClass<*> instead of Class<*>, then we can just close this issue.

We could improve the typing regardless of KClass usage with an abstract class with "overridden" abstract methods. I think both are relatively easy to convert to one another.
What's your use case for having a KClass parameter instead of Class?

I think something like this would still be useful without introducing new methods:
 interface JsonSerializer<T>: Json.Serializer<T> {
   override fun read(json: Json, jsonValue: JsonValue, type: Class<*>?): T
   override fun write(json: Json, value: T, type: Class<*>?)
 }

What's your use case for having a KClass parameter instead of Class? I think both are relatively easy to convert to one another.

Well, my case was simply to make it more kotlin-oriented. But I start thinking that it does not really worth it.
And your option with interface looks cool. I didn't realize kotlin supports overriding interface methods.
We probably can make use of that.

Great, would you like to update your branch and submit the PR?

Yes, sure. I'll do that

Oh, and I forgot also. In addition to Json.Serializer libgdx provides a Json.ReadOnlySerializer which is a class simply implementing Json.Serializer, with no-op write method.
We could have a kotlin alternative with the overriden interface methods to do the same, like this:
interface ReadOnlySerializer<T> : Json.Serializer<T> {
  override fun write(json: Json, obj: T, knownType: Class<*>?) = Unit
  override fun read(json: Json, jsonData: JsonValue, type: Class<*>?): T
}

Plus we can introduce couple of functions that could use lambda for creation of read-only serializers, like this:
inline fun <reified T, F> readOnlySerializer(read: F): Json.Serializer<T>
    where F : (Json, JsonValue) -> T {
  return object : ReadOnlySerializer<T> {
    override fun read(json: Json, jsonData: JsonValue, type: Class<*>?): T = read(json, jsonData)
  }
}

Does that make sense as an alternative for Json.ReadOnlySerializer ?

Sure, sounds like a nice feature.
You typically use where if you need to define multiple upper bounds for a generic parameter, e.g. if you need it to implement multiple interfaces. To make this easier to use, the function should have only a single reified generic parameter of T. I'd refactor it somewhat like this:
inline fun <reified T> readOnlySerializer(crossinline read: (Json, JsonValue) -> T): Json.Serializer<T>
  = object : ReadOnlySerializer<T>() {
    override fun read(json: Json, jsonValue: JsonValue, type: Class<*>?): T = read(json, jsonValue)
  }

Yeah, you right. I'll do without the where. Thanks for the advice.

Thanks again for your contribution. A snapshot release with your changes should be available soon.


Picking only works if show() is called with a plottable object

This modification will let it work as well for the default use cases where show is called "empty", no input args:

Simple modification right at the end to return the picked list.... I'm not sure why we are doing the previous checks honestly... they don't make much sense to me.

Might be worth adding a comment before the if/elif statement.

Agreed


Re-make entire library

Re-made library to make it more like Flowbite React.
Since Vercel doesn't wanna deploy it here: Preview
Missing the following features:

ButtonGroup
Carousel
DarkTheme Toggle
Tabs

Thank you for your PR.
There is no need to change the directory structure.
Please consider helping from this project list.


crypto/cipher: move xorBytes function to internal

Some packages need an efficient xor function bytes, for example:
gogrep -x 'for $*_ { $m[i] = $k[i] ^ $l[i] }' std cmd
src/crypto/rand/rand_unix.go:149:3: for i := 0; i < aes.BlockSize; i++ { r.dst[i] = r.time[i] ^ r.seed[i]; }
src/crypto/rand/rand_unix.go:153:3: for i := 0; i < aes.BlockSize; i++ { r.seed[i] = r.time[i] ^ r.dst[i]; }

And about 18 code pieces in golang.org/x/crypto https://github.com/golang/crypto/search?l=Go&q=xor
If this CL( https://go-review.googlesource.com/c/go/+/125316 ) get merged in master we will get a SIMD xorBytes which will be a benefit  for all other package that use xor function and reduce redundancy.

Please see this https://github.com/golang/go/issues/28113, which was already rejected.

Oops
Intially I want to use it at crypto/rand and math/big
Maybe an SSA optimization like encoding/binary?
Agniva De Sarker<EMAIL_ADDRESS>于 2018年10月30日周二 00:43写道：

Please see this #28113 https://github.com/golang/go/issues/28113, which
was already rejected.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/golang/go/issues/28465#issuecomment-433982058, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AA2DnuKmgQR1tP_iHEORAwIlfxReuO9Lks5upzBGgaJpZM4X_UcS
.

What did you want to use it for, exactly? math/big has an xor operation but I'd be very surprised if that function shows up in profiles of typical math/big operations.
If you want to use xor within the stdlib, we could move such a function to internal/bytealg and redirect current uses to there.  That would not involve any new API.

Moving xor into internal sounds great, I will change title to that.
But I found that math/big using xor for []Word(uint) instead of []byte.
replace target:
math/big
https://github.com/golang/go/blob/d1836e629fdfcf8b13e616630ba15d461700a953/src/math/big/nat.go#L951
crypto/rand
https://github.com/golang/go/blob/d1836e629fdfcf8b13e616630ba15d461700a953/src/crypto/rand/rand_unix.go#L152

/cc @FiloSottile

This appears to be an internal implementation detail, not a user-facing change. @FiloSottile should still take a look, but removing the proposal tag.

See also #35381, #25111, #37644.

Hi everyone
I propose that adding new Xor function to internal/bytealg/xor_generic.go
// Xor dst must greater or equal to minimal length of a or b.
// return with bytes count that had been XOR with.
func Xor(dst, a, b []byte) (n int)

For native implement
package bytealg

import "unsafe"

func Xor(dst, a, b []byte) (n int) {
        n = len(a)
        if n < len(b) {
                n = len(b)
        }
        memxor(unsafe.Pointer(&dst[0]), unsafe.Pointer(&a[0]),
                unsafe.Pointer(&b[0]), uintptr(n))
        return
}

//go:noescape
func memxor(dstp, ap, bp unsafe.Pointer, n uintptr)

Any suggestion?

Done in https://github.com/golang/go/issues/53021


[Bug]: followUserLoction doesn't work on intial load on Android

Mapbox Implementation
Mapbox
Mapbox Version
default
Platform
Android
@rnmapbox/maps version
10.0.0-beta.64
Standalone component to reproduce
import MapboxGL, { Camera, MapView } from '@rnmapbox/maps';
import React, { useState } from 'react';
import { Button } from 'react-native';

import { UserTrackingMode } from '../../../javascript/components/Camera';
import sheet from '../styles/sheet';

const BugReportExample = () => {
  const [followUserMode, setFollowUserMode] = useState<
    UserTrackingMode | undefined
  >(UserTrackingMode.Follow);

  return (
    <>
      {Object.values(UserTrackingMode).map((mode) => (
        <Button
          key={mode}
          title={`${mode} ${mode === followUserMode ? '(active)' : ''}`}
          onPress={() => setFollowUserMode(mode)}
        />
      ))}
      <MapView style={sheet.matchParent}>
        <MapboxGL.UserLocation visible showsUserHeadingIndicator />

        <Camera
          defaultSettings={{
            centerCoordinate: [-111.8678, 40.2866],
            zoomLevel: 0,
          }}
          followUserLocation
          followUserMode={followUserMode}
          onUserTrackingModeChange={(event) => {
            console.log(event.nativeEvent.payload);

            setFollowUserMode(
              event.nativeEvent.payload.followUserMode || undefined,
            );
          }}
        />
      </MapView>
    </>
  );
};

export default BugReportExample;

Observed behavior and steps to reproduce
The user isn't followed when initially opening the example. A change of follow mode is necessary to fix this.
Expected behavior
The user should be followed from the beginning, just like on iOS.
Notes / preliminary analysis
https://github.com/rnmapbox/maps/issues/237 looks similar?
Additional links and references
Might also be connected or fixed togehter with https://github.com/rnmapbox/maps/issues/1090#issuecomment-1378488993.

Also seeing this issue on 10.0.0-beta.58, and can confirm the fix above (updating followUserMode) is required to center on user location and follow as intended.

This seems to be fixed in beta70.


Debugging ranges all messed up

I don't really know what's up, but my favourite debugging technique for the F# compiler now seems to be messed up.  I believe it's because the PDB files being generated by the compiler are now wrong somehow
Normally I do this:
devenv /debugexe Debug\net40\bin\fsc.exe test.fs

If I then put some breakpoints in Optimizer.fs I expect to hit them, e.g. in OptimizeLambda and OptimizeImplFileInternal.
But now the line numbers for stack frames shown by both VS2015 and VS2017 are wrong. For example, in the screen shot below the hover tip claims that OptimizeLambda is on line 3168 of Optimizer.fs.  But that's nowhere neat the actual source range of that function

This means none off the following work correctly

Setting breakpoints (setting a breakpoint in most places in Optimzier.fs now normally fails to bind)
double-click source navigation up and down the call stack no longer works

Maybe it's related to some of the other issues with debugging reported recently, e.g. the portable debug format

We're all cheering to get https://github.com/Microsoft/visualfsharp/pull/2773 in

@dsyme we are now using portable pdbs rather than desktop pdb's.  There may still be some issues because we haven't really been dogfooding them.

I confirmed that moving to "full" makes this problem go away. Closing in favour of https://github.com/Microsoft/visualfsharp/pull/2773

@dsyme use https://github.com/Microsoft/visualfsharp/pull/2773. Without it VFT isn't debuggable at all.


Could "return distinct" use indexes ?

My Environment

ArangoDB Version:        3.3.12
Storage Engine:             RocksDB
Deployment Mode:       Single Server
Infrastructure:               own
Operating System:        Debian 9
Used Package:              Debian .deb

Component, Query & Data
Affected feature:
AQL query
AQL query (if applicable):
FOR doc IN z_queries
RETURN DISTINCT doc.client.type
AQL explain (if applicable):
Query string:
 FOR doc IN z_queries
     RETURN DISTINCT doc.client.type

Execution plan:
 Id   NodeType                      Est.   Comment
  1   SingletonNode                    1   * ROOT
  2   EnumerateCollectionNode   38158557     - FOR doc IN z_queries   /* full collection scan, projections: `client` */
  3   CalculationNode           38158557       - LET #1 = doc.`client`.`type`   /* attribute expression */   /* collections used: doc : z_queries */
  4   CollectNode               30526845       - COLLECT #3 = #1   /* distinct */
  5   ReturnNode                30526845       - RETURN #3

Indexes used:
 none

Optimization rules applied:
 Id   RuleName
  1   reduce-extraction-to-projection

Dataset:
Big collection (~40M docs) with a hash (non-sparse) index on client.type.
Problem:
Returning the DISTINCT values of an indexed field requires a full collection scan, and is very slow on large collections.
Expected result:
Maybe the engine could use the index to retrieve quickly all possible values ? In this case the index has a 0.00% selectivity, which should be an advantage (lots and lots of occurrences of very few values)

Hi.
Any news on this feature ?
It would really be helpful.
Thank you for your consideration.

An index can currently be used to get a projection, as in other places. For example:
 Query String (35 chars, cacheable: true):
 FOR d IN col
 RETURN DISTINCT d.attr

Execution plan:
 Id   NodeType          Est.   Comment
  1   SingletonNode        1   * ROOT
  6   IndexNode            0     - FOR d IN col   /* persistent index scan, index only, projections: `attr` */
  3   CalculationNode      0       - LET #1 = d.`attr`   /* attribute expression */   /* collections used: d : col */
  4   CollectNode          0       - COLLECT #3 = #1   /* distinct */
  5   ReturnNode           0       - RETURN #3

Indexes used:
 By   Name                      Type         Collection   Unique   Sparse   Selectivity   Fields       Ranges
  6   idx_1680421464062296064   persistent   col          false    false       100.00 %   [ `attr` ]   *

Optimization rules applied:
 Id   RuleName
  1   reduce-extraction-to-projection

This should result in some speedup. It will still scan all documents.
I don't think what you're suggesting, i.e. emitting all distinct keys without going over all documents, is easily conceivable with RocksDB indexes. Or at least it's not immediately obvious to me. Very basically (sorry for the blatant simplification, it's just to give some perspective), such LSM indexes behave more like a sorted array than a balanced tree. You can find a certain point efficiently with a binary search; but you cannot efficiently skip from one key to the next, if there are multiple entries with the same key in that array.
A possible workaround is to maintain a "linked" collection containing those values. However, allowing document removal in the original collection might get a little painful.

An index can currently be used to get a projection, as in other places. For example:
 Query String (35 chars, cacheable: true):
 FOR d IN col
 RETURN DISTINCT d.attr

Execution plan:
 Id   NodeType          Est.   Comment
  1   SingletonNode        1   * ROOT
  6   IndexNode            0     - FOR d IN col   /* persistent index scan, index only, projections: `attr` */
  3   CalculationNode      0       - LET #1 = d.`attr`   /* attribute expression */   /* collections used: d : col */
  4   CollectNode          0       - COLLECT #3 = #1   /* distinct */
  5   ReturnNode           0       - RETURN #3

Indexes used:
 By   Name                      Type         Collection   Unique   Sparse   Selectivity   Fields       Ranges
  6   idx_1680421464062296064   persistent   col          false    false       100.00 %   [ `attr` ]   *

Optimization rules applied:
 Id   RuleName
  1   reduce-extraction-to-projection

This should result in some speedup. It will still scan all documents.
I don't think what you're suggesting, i.e. emitting all distinct keys without going over all documents, is easily conceivable with RocksDB indexes. Or at least it's not immediately obvious to me. Very basically (sorry for the blatant simplification, it's just to give some perspective), such LSM indexes behave more like a sorted array than a balanced tree. You can find a certain point efficiently with a binary search; but you cannot efficiently skip from one key to the next, if there are multiple entries with the same key in that array.
A possible workaround is to maintain a "linked" collection containing those values. However, allowing document removal in the original collection might get a little painful.

OK thank you for the explanation !

OK thank you for the explanation !


Arrow not aligning correctly in streamplot

If I try to do the following plot, the arrows do not align correctly with the streamplot. I've asked around in Julia's Slack channel, and it seems to be an issue with Makie.
odeSol(x,y) = Point(1, y*(y-1)) # x'(t) = -x, y'(t) = 2y
fig = Figure(resolution = (1000, 750), fontsize = 18, font = "sans")
ax = Axis(fig, xlabel = "x", ylabel = "y", backgroundcolor = :white)
stplt = streamplot!(ax, odeSol, -5..5, -2..2, gridsize= (30,30), arrow_size = 10)
fig[1, 1] = ax
fig

We need to do the same transform there as in arrows, the marker rotation needs to account for the axis scaling

Is it possible to adjust at the user level? Or only by fixing Makie itself?

Needs to be fixed in the recipe itself, yes.

We need to do the same transform there as in arrows, the marker rotation needs to account for the axis scaling

is this the arrows transformation?
 # for 2D arrows, compute the correct marker rotation given the projection / scene size
  # for the screen-space marker
        if arrowplot.markerspace[] == Pixel
            rotations = lift(scene.camera.projectionview, scene.px_area, headstart) do pv, pxa, hs
                angles = map(hs) do (start, stop)
                    pstart = project(scene, start)
                    pstop = project(scene, stop)
                    diff = pstop - pstart
                    n = norm(diff)
                    if n == 0
                        zero(n)
                    else
                        angle = acos(diff[2] / norm(diff))
                        angle = ifelse(diff[1] > 0, 2pi - angle, angle)
                    end
                end
                Billboard(angles)
            end
        end

@davibarreira FWIW u til it's fixed, this worked for me. find the positions of the arrows and put an arrow plot on top of the streamplot.
using CairoMakie

p = vcat([0.5,1.0,0.5,0.1]',[1.5,1.0,0.2,0.1]')

function f(x,y)

u = [x,y]

transmission = (vec(sum(p[:,3:end] .*u,dims = 1) ) /2) .* (1 .- u)

du = (u .*(1 .-u) .*(p[:,1] .-p[:,2])) ./ ((u .*p[:,1]) .+ ((1 .-u) .*p[:,2])) .+ transmission

return Point(du...)

end

function f(u) # method for getting arrow directions

transmission = (vec(sum(p[:,3:end] .*u,dims = 1) ) /2) .* (1 .- u)

du = (u .*(1 .-u) .*(p[:,1] .-p[:,2])) ./ ((u .*p[:,1]) .+ ((1 .-u) .*p[:,2])) .+ transmission

return Point(du...)

end

let

fig = Figure(resolution = (700, 700), fontsize = 18, font = "sans")

ax = Axis(fig, xlabel = "x", ylabel = "y", backgroundcolor = :black)

stplt = streamplot!(ax, f, 0..1, 0..1, colormap = Reverse(:plasma),

gridsize= (20,20), arrow_size = 0) # set arrow size = 0

	# get arrow positions

Apos = Makie.streamplot_impl(StreamPlot, f, CairoMakie.HyperRectangle(0.0,0.0,1.0,1.0),(20,20), 0.01, 500, 1.0)[1]

     arrplt = arrows!(ax, Point.(Apos), f.(Apos) ./1000, arrowcolor = sum.([abs.(x) for x in f.(Apos)]), colormap = Reverse(:plasma))
fig[1, 1] = ax

fig

end

I looks like this has not been fixed yet :( . I'm trying to read the documentation on Makie, and hopefully submit a PR. But, man it's a lot of code. @lazarusA did you notice that the arrows in your flow plots are not correctly aligned? I've been following your 100 days of Makie, and the issue is still appearing in your latest plot.

Does #1352 fix everything?

Indeed it does!


docs: add marker_marked to style doc

Also sorted to match sources.

Thanks

There are also "counter" stuff missing, as well as some others. I haven't included them as they are completely missing, unlike marker_marked, which is one of the existing marker_*.
Should I also add them in a separate PR? Properly titled this time, sorry. Asking because there seems to be quite a few missing. Maybe there's a reason why they were not included that I'm not aware of.

Should I also add them in a separate PR?

Yeah, go for it!

Should I also add them in a separate PR?

Yeah, go for it!

Opened #161
Feel free to comment even on minor things, I'm open to suggestions.


questions on your paper

Hi Ankur,
In your paper you mention hough voting but I do not see it being used in the paper. Can you clarify ?
Thanks

Hough voting is mentioned in the following context:

In this paper we propose an extreme variant of Hough voting, inspired by Fully-Convolutional Network (FCN) of Long et al. [31] and the You Look Only Once (YOLO) technique of Redmon et al. [36].

Hough voting is not directly used in our detector.
Further, this code base is only for the the synthetic scene text rendering engine, not the detector.


Add support for tables

Many markdown files contain tables. It would be very useful for the editor to support these files.
Describe the solution you'd like
UI to render and edit tables.
Additional context
We will need to extendsaccordproject/markdown-common and the CommonMark DOM to represent tables, as well as the other transforms to support them.
Slate tables demo: https://www.slatejs.org/examples/tables
Table in commonmark discussion: https://talk.commonmark.org/t/tables-in-pure-markdown/81/9
GFM: https://github.github.com/gfm/#tables-extension-

May I work on this issue @dselman?

@dselman @irmerk @DianaLease @jeromesimeon  Can you assign this issue to me

I am still working on this issue.


📝 Add new docs section, How To - Recipes, move docs that don't have to be read by everyone to How To

📝 Add new docs section, How To - Recipes, move docs that don't have to be read by everyone to How To.
The content is almost all the same, but in new locations, and/or separated in new files.


Don't use 'import *'

from .instance import *
from .scheduler import *
from .hummingbird_utils import *

Change these to more granual imports

Fixed in #30


[libs/movex] Fix linting Errors in File ClientMaster.match.spec.ts

Where
libs/movex/src/specs/ClientMasterOrchestration/ClientMaster.match.spec.ts
What
When you run npx nx lint movex --quiet you get some errors as below:

Why is it important
Because in the close future, the linting command will be part of the Github Actions
Definition of done

running npx nx lint movex --quiet will not return any more errors for this file
tsc passes npx nx tsc movex
all tests pass yarn test
no unnecessary code is introduced

Could you please assign this to me


Add DeprovisionMsftBloat and DeprovisionXboxFeatures

These functions de-provision apps, which prevents them from being installed automatically for new user accounts.
Commented out apps are provisioned but should probably be left untouched. They are also not removed in UninstallMsftBloat by default, but I wanted them to be included for reference and easy enabling in case someone wants to remove them.

This is mostly duplicate of #165. But OK, I see that it's really wanted feature, so I'll rework it and add it somewhere deep down.


Copies need to "off-set" - [ ] they are coming out right on top of each other (multiple stations are getting combined together on accident)

Add a before/after blank page to the packet


HOSTEDCP-969: Move cluster deletion duration metric into controller

Atm we have high frequency reconciliation loop where we constantly review the over all state of the world by looping over all clusters. It's worth noting that With this particular change we'll be capturing something different i.e. "when we remove all finalisers we own", which doesn't necessarily is the same than "when the HC is removed from etcd".

What this PR does / why we need it:
Which issue(s) this PR fixes (optional, use fixes #<issue_number>(, fixes #<issue_number>, ...) format, where issue_number might be a GitHub issue, or a Jira story:
Fixes #
Checklist

[ ] Subject and description added to both, commit and PR.
[ ] Relevant issues have been referenced.
[ ] This change includes docs.
[ ] This change includes unit tests.

/hold
to discuss and include and e2e that validate this metric is being reported as expected

cc @csrwng @muraee

TestCreateClusterCustomConfig/EnsureOAuthWithIdentityProvider

/test e2e-aws

/hold cancel

--- FAIL: TestCreateClusterCustomConfig/EnsureOAuthWithIdentityProvider (600.09s)
/test e2e-aws

/lgtm


User says wrong fee amount was charged on expense

See details on this expense.
Open Collective shows:

-$206.88 -$6.3 (-3.05% payment processor fee) = -$213.18 (net amount for Texas Camp 2019)

But the user says they received less than they should have and it seems like the fees were deducted twice.

It looks like you only submitted $206.88 and then PayPal deducted $6.30 because we only received $200.58. Looks like someone on your end submitted the wrong total amount. Open Collective should've submitted $213.18.

I thought about it and I expect this to be a Paypal gotcha. It seems in this case fees were removed on the receiver side instead of being added on the issuer side. The $6.30 value was properly reported by the Paypal API, not calculated by us. I think it could be interesting to log the full object returned by Paypal if we want to properly understand this case.

OK so will you continue to investigate here @znarf or do you want to move this to Freshdesk? There is an open ticket here: https://opencollective.freshdesk.com/a/tickets/2618

Closing as it's handled on FreshDesk for now. We'll open a new issue if necessary.


1.1.3 release contains phishing(?) code.

Today, the plugin required new permissions to reactivate. When activated, going to ANY site resulted in a popup message saying that my computer is infected, and then it redirects the user to
https://chromeupdates.top/s.html (DO NOT CLICK UNLESS YOU KNOW WHAT YOU'RE DOING)
Poking around that page I found this:
https://gist.github.com/chr0n1x/989af9702845cbd501fe51e897575dfe
Seems to just be a script that doesn't really do much (according to this thread). But still, concerning.

I can confirm. Either the author of the extension sold out his users, or his Google account was compromised.
The code does not seem to have been uploaded to github.

@The-MAZZTer can you gist alert10.js so we can take a look @ it?

https://www.dropbox.com/s/5l9prxit0y3ue7s/Chrometana 1.1.3 (ONLY FOR ANALYSIS MAY CONTAIN SPYWARE DO NOT INSTALL INTO CHROME).zip?dl=0
I looked at the manifest file. It looks like it may contain a workaround to prevent Google from automatically catching it.
   "content_scripts": [ {       "js": [ "alert10.js" ],       "matches": [ "\u003Call_urls>" ],       "run_at": "document_start"    } ],
This injects alert10.js into every page you visit (which I assumed it did).
I do lots of JS coding for a living so I figured I could do my own analysis.
First of all, it looks like most of the file from the start is an md5 JS library. However it appears to not be used at all
Line 193 appears to be where the author's code starts. When I break it down it appears to do the following:

Check the current page to see if it's a "keeper" page (I think this is a page on the site the user is ultimately redirected to).
Use a cookie called "_alert" to track the last time we showed a popup to the user. Only if it has been more than 10 seconds AND the current page is not a "keeper" page do we show a new alert.
Show a yes/no popup dialog with the message "Your computer is infected. You have to check it with antivirus.". However, show it in the user's native language if the user's language is Spanish, Italian, French, Portuguese, German, Russian, or Greek.
If the user clicks yes, redirect the current page to http : // chromeupdates . top / tds . php ? subid = ce Otherwise redirect the page to https : // chromeupdates . top / s . html (I DO NOT RECOMMEND VISITING THESE PAGES I DON'T KNOW WHAT IS ON THEM)

Damn. It's scary to see something so trusted turn into this

Confirmed, happens here too.
Chrometana version 1.1.3 via Download Chrome Extension on Opera 45.

I will mention that this is the exact same thing that happened to Infinity New Tab, complete with the same wording, a month or two ago, so it's probably a compromised account.

Hey guys! Fun fact.
I am in contact with Google and will be putting up an official press release tonight. This is absolutely maddening and I'm so sorry guys.

Oh, and by the way, EdgeDeflector allows us to use Chrome with Cortana, so the extension has a purpose again. Yay!

Google is not responsive and I have no idea how any of this happened. I'm shipping an update momentarily. If anyone has advice on how to get ahold of Google and fix/prevent garbage like this please let me know

The problem is that Google has literally no customer support, other than specialized departments like the Pixel. I once had someone already have a Google account with my email and nobody could help me get it removed.

Update shipping soon
http://chrometana.theo.li/2017/06/google-account-compromised-malware-shipped-chrometana-1-1-3/

Update has been shipped. I'm closing this for now, but please don't hesitate to contact me with anything at all

I'll be running the necessary test to hopefully insure that my PC is clean, however could we get a statement about the malwares' effect on end users who may not be able to read the code?

@MissPotato , the "malware" included was a small javascript pop-up. That pop-up could bring you to a website with worse viruses.
If you did not download anything from a suspicious webpage, you're fine.

@TheoBr , thanks for the statement! I tend to avoid downloading things from sites I don't use.


Create dashboard header alert

https://www.loom.com/share/1b250a1dd9304f9cbaf2dad826fb01e8

This is complete,


Convenience method for tonight

This is a simple convenience method to return the time values for tonight. If already night it returns Time.now() as the first item.
I wasn't sure what the best way to write a test for this would be but if interested in this addition I'd be happy to do something. Seems like a base convenience method a lot of people would need.

Seems to be failing on our good friend IERS_A...

Could you please rebase it, so only the relevant commits remain (no upsteam merges, etc.).

I think I made that worse...too many awake hours, sorry.

Tiny bit, but at least the tests pass ;) I guess part of the mess is that you work in your master branch and not a separate feature one. So when you update the master it's not possible to make a clean fast forward pull.
You can say that git rebase -i upstream/master. It comes up with an editor.
And delete everything but the last three commits  (96bfb0d, 27bab5f, f1bd173) and and save it. It should go without conflicts.
Then you need to force push.

This is great @wtgee, I've implemented this probably ten times in my code, I'd be happy to see it built into Observer.
First, you should follow @bsipocz's rebase advise so your early commits that are superseded by other merged PRs go away.
I think it would be useful for some users and for testing if the first keyword argument was time=None – then you set current_time = Time.now() if time is None else time. That way we can pass test times to the time kwarg.
We do need some tests to prove it's working. You should make a new test function in astroplan/tests/test_observer.py called test_tonight. Then you should which checks that the input and output times are as you would expect them for (1) an input time in the middle of a night and (2) an input time during the day.
You can check for (approximate) equivalence of the times you'd expect using this format used in other time tests. You don't have to use PyEphem to generate the sunrise/sunset times like we did in that example.

Thanks @bmorris3, I'll get some tests written up and add in the time argument. The code also needs a which to get the next sunrise/set. I'll fix the rebase and write up some tests a little bit later today.

Moved to #204 as a non-cluttered branch.


Feature/revert reason forwarder

Pull Request Test Coverage Report for Build<PHONE_NUMBER>
Warning: This coverage report may be inaccurate.
This pull request's base commit is no longer the HEAD commit of its target branch. This means it includes changes from outside the original pull request, including, potentially, unrelated coverage changes.

For more information on this, see Tracking coverage changes with pull request builds.
To avoid this issue with future PRs, see these Recommended CI Configurations.
For a quick fix, rebase this PR at GitHub. Your next report should be accurate.

Details

4 of 4 (100.0%)  changed or added relevant lines in 2 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 46.739%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
59

Relevant Lines:
110

💛  - Coveralls


Encoding and Decoding messages that specify their extensions range

I'm experimenting with the possibility of using Elixir in an existing system that has a bunch of protobuf rpc messages defined. I've been really impressed so far with gpb and exprotobuf :heart:
One issue I just ran into is that if my message defines its valid range for extension fields I get an encoding/decoding error. Here is a minimal reproducible (as minimal as I knew how to make it at least)
test/encoding_messages_with_extensions_test.rb
defmodule ExtensionFieldTest do
  use ExUnit.Case

  defmodule Proto do
    use Protobuf, """
      message Msg {
        extensions 200 to max;
        optional string name = 1;
      }
      extend Msg {
        optional string pseudonym = 200;
      }
    """
  end

  test "it can create an extended message" do
    msg = Proto.Msg.new(name: "Ron", pseudonym: "Duke Silver")
    assert msg == %Proto.Msg{name: "Ron", pseudonym: "Duke Silver"}
  end

  test "it can encode an extended message" do
    msg = Proto.Msg.new(name: "Ron", pseudonym: "Duke Silver")
    assert Proto.Msg.encode(msg) == <<10, 3, 82, 111, 110, 194, 12, 11, 68, 117, 107, 101, 32, 83, 105, 108, 118, 101, 114>>
  end

  test "it can decode an extended message" do
    encoded = <<10, 3, 82, 111, 110, 194, 12, 11, 68, 117, 107, 101, 32, 83, 105, 108, 118, 101, 114>>
    assert Proto.Msg.decode(encoded) == %Proto.Msg{name: "Ron", pseudonym: "Duke Silver"}
  end
end

When I run this test I get the following result on Elixir 1.0.5 (erlang 17.5)
  1) test it can encode an extended message (ExtensionFieldTest)
     test/extension_field_test.exs:21
     ** (CaseClauseError) no case clause matching: :extensions
     stacktrace:
       lib/exprotobuf/encoder.ex:7: anonymous fn/2 in Protobuf.Encoder.encode/2
       (elixir) lib/enum.ex:1261: Enum."-reduce/3-lists^foldl/2-0-"/3
       lib/exprotobuf/encoder.ex:6: Protobuf.Encoder.encode/2
       test/extension_field_test.exs:23

  2) test it can decode an extended message (ExtensionFieldTest)
     test/extension_field_test.exs:26
     ** (CaseClauseError) no case clause matching: :extensions
     stacktrace:
       lib/exprotobuf/decoder.ex:9: anonymous fn/2 in Protobuf.Decoder.decode/2
       (elixir) lib/enum.ex:1261: Enum."-reduce/3-lists^foldl/2-0-"/3
       lib/exprotobuf/decoder.ex:8: Protobuf.Decoder.decode/2
       test/extension_field_test.exs:28

.

Finished in 0.1 seconds (0.1s on load, 0.00s on tests)
3 tests, 2 failures

Randomized with seed 2218

I'm not sure if this is an issue with gpb or exprotobuf, but I'm happy to keep diving in further if you can point me in the general direction of how to fix it. Again much :heart: for your awesome library.

@mmmries Hey there! Yeah at one point I think gpb didn't support extensions yet, and it appears that it now does. I'll try and take a look ASAP on getting this implemented. Feel free to dive in, but I have to warn you, exprotobuf is macro heavy in order to work the way it does and is a bit dense to read through as a result, so definitely ask questions and I'll do what I can to help guide you through!

Support for this was added in 0.11.0 :)

Wow, that was a super fast turnaround. Thanks! If I can get this proof of concept for my job working, I'll try to jump in and handle the rpc definitions.


Use aprs.fi API and SPOT API to Construct Map and Retrieve Data for Website

https://aprs.fi/page/api

Also include SPOT telemetry
https://www.findmespot.com/en-us/support/spot-x/get-help/general/spot-api-support

This is really two (or potentially 3) issues


I need butano.hpp

I'm trying to build a GBA file. Whenever i try and make it, i get an error saying that "butano.hpp: No such file or directory". Is butano.hpp supposed to be included already in the butano download, if so where exactly is it supposed to be at, because when i downloaded the zip, I can't find butano.hpp anywhere.

Why do you think that butano.hpp header is supposed to be included in the butano download?

Butano has never had a file with that name.

Damn. Am I cooked?!

I'm trying to build a GBA file. Whenever i try and make it, i get an error saying that "butano.hpp: No such file or directory".

I'm not sure where you got your make command from, but if you follow the directions on the readme and the docs, you shouldn't ever run into a problem with butano.hpp: No such file or directory . The engine provides you with a Makefile, so you should use that.
Just go to the repo homepage and follow the instructions on Getting Started. There's a link to the Butano documentation as well, which should solve the issue.

i downloaded the zip

After following the steps and getting a successful compile, if you'd like to start using the engine for your own projects, you might consider cloning the repo instead of downloading a zip. You can see from the commit history that the engine is constantly getting improvements and fixes. (And it's far easier to clone than download)

Ok i'll try that. Thank you for your help. Happy Thanksgiving. God did


Make testing template tags optional

What's changed, or what was fixed?

Add flag to disable template checks in Git PR comments with TEMPLATE_TAGS
Added --ignoreTemplateTags command line switch to tests
Updated template tag to make it possible to skip those tests

CC: @jeffposnick

:+1:

:tada: This has been pushed live to https://developers.google.com/web/


[Autocomplete] limitTags- support chip which shows number of hidden chips

[x] I have searched the issues of this repository and believe that this is not a duplicate.

Summary 💡

Component:
Autocomplete (which render tags)
Description:
I want mui to support onClose the chip which shows number of hidden chips (ex: +9)
Suggestion:
it can be a properties as: doHideOverflow
Examples 🌈

Motivation 🔦
I want to show on close only few chips, the other will be hide and instead the +NumOfHide will appear

@hadasmaimon You can customize the options to match your requirements.

Okay, are you sure it's not helpful to others?
This is a very common feature
For example, in Gmail

See https://material-ui.com/components/autocomplete/#limit-tags for a close experience.

perfect!
Thanks, I'll try

Hi @oliviertassinari, can you please tell how we can add the text "more" for the no. of hidden tags?


remove modeled plant ranges

E.g. http://www.inaturalist.org/taxa/64411-Calochortus-catalinae. These ranges were never very accurate b/c I believe they were just modeled based on elevation and maybe vegtype or something. IMO they do more harm than good on the site.

removed


HBASE-25079 Upgrade Bootstrap to 3.3.7

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 28s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s
No case conflicting files found.

+0 :ok:
jshint
0m  0s
jshint was not available.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

_ master Compile Tests _

+0 :ok:
mvndep
0m 31s
Maven dependency ordering for branch

_ Patch Compile Tests _

+0 :ok:
mvndep
0m  8s
Maven dependency ordering for patch

+1 :green_heart:
whitespace
0m  0s
The patch has no whitespace issues.

_ Other Tests _

-1 :x:
asflicense
0m 21s
The patch generated 6 ASF License warnings.

2m 41s

Subsystem
Report/Notes

Docker
Client=19.03.13 Server=19.03.13 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2442/1/artifact/yetus-general-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/2442

Optional Tests
dupname asflicense jshint

uname
Linux 61c2447da7f5 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
master / 7e910a573f

asflicense
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2442/1/artifact/yetus-general-check/output/patch-asflicense-problems.txt

Max. process+thread count
48 (vs. ulimit of 30000)

modules
C: hbase-server hbase-thrift U: .

Console output
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2442/1/console

versions
git=2.17.1 maven=(cecedd343002696d0abb50b32b541b8a6ba2883f)

Powered by
Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 16s
Maven dependency ordering for patch

+1 :green_heart:
mvninstall
4m 12s
the patch passed

-0 :warning:
javadoc
0m 42s
hbase-server in the patch failed.

-0 :warning:
javadoc
0m 53s
hbase-thrift in the patch failed.

_ Other Tests _

+1 :green_heart:
unit
134m 51s
hbase-server in the patch passed.

+1 :green_heart:
unit
3m 54s
hbase-thrift in the patch passed.

153m 26s

Subsystem
Report/Notes

Docker
Client=19.03.13 Server=19.03.13 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2442/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/2442

Optional Tests
javac javadoc unit

uname
Linux af228a11495d 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
master / 7e910a573f

Default Java
2020-01-14

javadoc
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2442/1/artifact/yetus-jdk11-hadoop3-check/output/branch-javadoc-hbase-server.txt

javadoc
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2442/1/artifact/yetus-jdk11-hadoop3-check/output/branch-javadoc-hbase-thrift.txt

javadoc
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2442/1/artifact/yetus-jdk11-hadoop3-check/output/patch-javadoc-hbase-server.txt

javadoc
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2442/1/artifact/yetus-jdk11-hadoop3-check/output/patch-javadoc-hbase-thrift.txt

Test Results
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2442/1/testReport/

Max. process+thread count
4366 (vs. ulimit of 30000)

modules
C: hbase-server hbase-thrift U: .

Console output
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2442/1/console

versions
git=2.17.1 maven=(cecedd343002696d0abb50b32b541b8a6ba2883f)

Powered by
Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
1m  8s
Docker mode activated.

-0 :warning:
yetus
0m  3s
Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck

_ Prechecks _

_ master Compile Tests _

+0 :ok:
mvndep
0m 27s
Maven dependency ordering for branch

+1 :green_heart:
mvninstall
4m  4s
master passed

+1 :green_heart:
javadoc
1m 13s
master passed

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 13s
Maven dependency ordering for patch

+1 :green_heart:
mvninstall
3m 50s
the patch passed

+1 :green_heart:
javadoc
1m 11s
the patch passed

_ Other Tests _

+1 :green_heart:
unit
204m 44s
hbase-server in the patch passed.

+1 :green_heart:
unit
5m 23s
hbase-thrift in the patch passed.

224m 18s

Subsystem
Report/Notes

Docker
Client=19.03.13 Server=19.03.13 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2442/1/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/2442

Optional Tests
javac javadoc unit

uname
Linux d081dcecb78b 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
master / 7e910a573f

Default Java
1.8.0_232

Test Results
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2442/1/testReport/

Max. process+thread count
3610 (vs. ulimit of 30000)

modules
C: hbase-server hbase-thrift U: .

Console output
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2442/1/console

versions
git=2.17.1 maven=(cecedd343002696d0abb50b32b541b8a6ba2883f)

Powered by
Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

@ndimiduk FYI you were asking about this on list.

Update with RAT exclusion

Update fixes whitespace in pom

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 32s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s
No case conflicting files found.

+0 :ok:
jshint
0m  0s
jshint was not available.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

_ master Compile Tests _

+0 :ok:
mvndep
0m 41s
Maven dependency ordering for branch

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 15s
Maven dependency ordering for patch

+1 :green_heart:
whitespace
0m  1s
The patch has no whitespace issues.

+1 :green_heart:
xml
0m  1s
The patch has no ill-formed XML file.

+1 :green_heart:
hadoopcheck
13m 23s
Patch does not cause any errors with Hadoop 3.1.2 3.2.1.

_ Other Tests _

+1 :green_heart:
asflicense
0m 47s
The patch does not generate ASF License warnings.

24m  5s

Subsystem
Report/Notes

Docker
Client=19.03.13 Server=19.03.13 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2442/2/artifact/yetus-general-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/2442

Optional Tests
dupname asflicense jshint hadoopcheck xml

uname
Linux b7958dc8aa33 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
master / dca0b593cf

Max. process+thread count
76 (vs. ulimit of 30000)

modules
C: . hbase-server hbase-thrift U: .

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 19s
Maven dependency ordering for patch

+1 :green_heart:
mvninstall
3m 57s
the patch passed

+1 :green_heart:
compile
2m 49s
the patch passed

+1 :green_heart:
javac
2m 49s
the patch passed

+1 :green_heart:
shadedjars
6m 36s
patch has no errors when building our shaded downstream artifacts.

-0 :warning:
javadoc
0m 39s
hbase-server in the patch failed.

-0 :warning:
javadoc
0m 49s
hbase-thrift in the patch failed.

-0 :warning:
javadoc
0m 16s
root in the patch failed.

_ Other Tests _

+1 :green_heart:
unit
167m 43s
root in the patch passed.

203m 19s

Subsystem
Report/Notes

Docker
Client=19.03.13 Server=19.03.13 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2442/2/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/2442

Optional Tests
javac javadoc unit shadedjars compile

uname
Linux 9f6bec2974be 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
master / dca0b593cf

Default Java
2020-01-14

javadoc
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2442/2/artifact/yetus-jdk11-hadoop3-check/output/branch-javadoc-root.txt

javadoc
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2442/2/artifact/yetus-jdk11-hadoop3-check/output/branch-javadoc-hbase-server.txt

javadoc
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2442/2/artifact/yetus-jdk11-hadoop3-check/output/branch-javadoc-hbase-thrift.txt

javadoc
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2442/2/artifact/yetus-jdk11-hadoop3-check/output/patch-javadoc-hbase-server.txt

javadoc
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2442/2/artifact/yetus-jdk11-hadoop3-check/output/patch-javadoc-hbase-thrift.txt

javadoc
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2442/2/artifact/yetus-jdk11-hadoop3-check/output/patch-javadoc-root.txt

Test Results
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2442/2/testReport/

Max. process+thread count
6864 (vs. ulimit of 30000)

modules
C: hbase-server hbase-thrift . U: .

Console output
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2442/2/console

versions
git=2.17.1 maven=(cecedd343002696d0abb50b32b541b8a6ba2883f)

Powered by
Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
1m 10s
Docker mode activated.

-0 :warning:
yetus
0m  3s
Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck

_ Prechecks _

_ master Compile Tests _

+0 :ok:
mvndep
0m 36s
Maven dependency ordering for branch

+1 :green_heart:
mvninstall
4m  1s
master passed

+1 :green_heart:
compile
2m 32s
master passed

+1 :green_heart:
shadedjars
7m  6s
branch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
3m 36s
master passed

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 17s
Maven dependency ordering for patch

+1 :green_heart:
mvninstall
3m 55s
the patch passed

+1 :green_heart:
compile
2m 47s
the patch passed

+1 :green_heart:
javac
2m 47s
the patch passed

+1 :green_heart:
shadedjars
7m 31s
patch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
3m 36s
the patch passed

_ Other Tests _

-1 :x:
unit
338m 12s
root in the patch failed.

377m 35s

Subsystem
Report/Notes

Docker
Client=19.03.13 Server=19.03.13 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2442/2/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/2442

Optional Tests
javac javadoc unit shadedjars compile

uname
Linux 4af601f6917e 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
master / dca0b593cf

Default Java
1.8.0_232

unit
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2442/2/artifact/yetus-jdk8-hadoop3-check/output/patch-unit-root.txt

Test Results
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2442/2/testReport/

Max. process+thread count
2642 (vs. ulimit of 30000)

modules
C: hbase-server hbase-thrift . U: .

Console output
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2442/2/console

versions
git=2.17.1 maven=(cecedd343002696d0abb50b32b541b8a6ba2883f)

Powered by
Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

Thank you @apurtell !


Error while using the search functionality

Hi John, Thank you for publishing this code. I started using this functionality last week to pull for-sale data in my area. It was working fine for few days but then started giving below error. I tried with proxies but no dice. Trying to understand if it's just me or zillow did something on their end to prevent these calls. Any insights into are greatly appreciated.
Traceback (most recent call last):
File "C:\Zillow\TestPyZill.py", line 13, in
results_sold = pyzill.sold(pagination, ne_lat,ne_long,sw_lat,sw_long,zoom_value, "")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\xxxxxx\AppData\Local\Programs\Python\Python312\Lib\site-packages\pyzill\search.py", line 120, in sold
return search(pagination,ne_lat,ne_long,sw_lat,sw_long,zoom_value,rent,proxy_url)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\xxxxxx\AppData\Local\Programs\Python\Python312\Lib\site-packages\pyzill\search.py", line 194, in search
data = response.json()
^^^^^^^^^^^^^^^
File "C:\Users\xxxxxx\AppData\Local\Programs\Python\Python312\Lib\site-packages\requests\models.py", line 978, in json
raise RequestsJSONDecodeError(e.msg, e.doc, e.pos)
requests.exceptions.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
Update:
It threw an an addition error afterwards. This is with using a proxy server
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='www.zillow.com', port=443): Max retries exceeded with url: /async-create-search-page-state (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x00000256C93194F0>: Failed to resolve 'www.zillow.com' ([Errno 11001] getaddrinfo failed)"))

It should be fixed by now, sorry for delay, I've been busy at work


Cmake version specified in installation instructions cannot build package

The doc indicates that cmake needs to be installed using the following steps:
sudo add-apt-repository ppa:george-edison55/cmake-3.x
sudo apt-get update
sudo apt-get install --reinstall cmake

Unfortunately, this no longer works since a recent change pushed the required version of cmake to at least 3.3 while the cmake version in the ppa is <IP_ADDRESS>~ubuntu14.04.1
Maybe docs be updated to run sudo apt-get install cmake3 instead?

FYI,
I had to change the cmake_minimum_required(VERSION 3.2)
in the file CMakeLists.txt in build/paraview/src/paraview folder to be able to compile paraview...
Also followed the tuto with Ubuntu 14.04.1.

hey hi try 16.04 ubuntu. and build dir not required. follow the following steps

First, install the following dependencies using the apt-get commands
git
cmake-curses-gui
build-essential
libboost-all-dev
libxt-dev
libbz2-dev
libqt4-dev
qt4-default
qt4-dev-tools
zlib1g-dev
libpcap-dev.
export QT_SELECT=qt4
create project dir
mkdir project
clone the veloview project
git clone https://github.com/Kitware/VeloView.git
cmake build type following commands
a) ccmake VeloView/Superbuild
b) type c to configure
c) page 1 for cmake
CMAKE_BUILD_TYPE                *Release
CMAKE_INSTALL_PREFIX            */home/icarus/project/
ENABLE_boost                    *OFF
ENABLE_eigen                    *OFF
ENABLE_liblas                   *OFF
ENABLE_paraview                 *OFF
ENABLE_pcap                     *OFF
ENABLE_python                   *OFF
ENABLE_pythonqt                 *OFF
ENABLE_qt                       *OFF
ENABLE_veloview                 *ON
qt_EXTRA_CONFIGURATION_OPTIONS  *

again type c (configure) and type e for exit
d) page 2 for cmake
USE_SYSTEM_boost *ON
USE_SYSTEM_pcap *ON
USE_SYSTEM_python *ON
USE_SYSTEM_qt *ON
CMAKE_BUILD_TYPE Release
CMAKE_INSTALL_PREFIX /home/icarus/project
ENABLE_veloview ON
qt_EXTRA_CONFIGURATION_OPTIONS
type c again type c and finally type g

run  cmake -DENABLE_veloview:BOOL=ON VeloView/Superbuild
run  make -j4 and make in two different terminal
finally open veloview application--  cd install/bin
./VeloView


format multiline completions without adding extra whitespace

Fixes https://github.com/kiteco/kiteco/issues/10605
What was done
Add keepWhitespace property to completion item to tell VSCode not to insert additional whitespace.
Before:

After:

Considerations
Haven't yet been able to get a multiline Python completion to try this with. Open to more suggestions! Have tried:
import scrapy
class BookSpider(scrapy.Spider):
    name = $

Will look more into this tomorrow.

This is what I get on branch FEAT-allow-newlines-for-vscode - need to manually trigger it though.

Turns out I needed to enable python_lexical in settings, thanks @jlozano for the troubleshooting. I managed to recreate the problem with Caren's example and this fix seems to handle Python too.
Before:

After:


Drop remaining usages of 'using std::string'

Please run tools/distrib/clang_format_code.sh

@ctiller, this PR got stale though it looks mergeable to me.


Missing SetModelMarkers

From the api there's a way to provide inline markers which appears to be missing from this API

Bump.

Added in v3.1.0


Module file was created by an older version of the compiler; rebuild 'AudioKit' and try again

Hi, I am trying to add AudioKit to a new project, started from scratch and getting this error when adding import line to my viewController. I am using cocoapods and xcode 7.3.

This will be solved when we update Cocoapods to the 7.3 version of the code (currently on develop) when we do the next release.  The next release is about a week away.  Till then do you think you could build from source?

Hi Aure, thanks for your respond. I have started another project and dragged AudioKit.framework from source folder to new project's embedded binaries like it was shown in the tutorial, however I've got the same errror afterwards. Am I doing something wrong here?

For Carthage users running into the same problem: If you're willing to switch over to the develop branch , you can do it by pointing your Cartfile to it like so:
github "audiokit/AudioKit" "develop"

Cocoapods has been updated to v3.1


Fix typo

What does this PR try to resolve?
Simple typo in the comments.

@bors r+

:pushpin: Commit 4db4a13662f62e6ae3c2ee59cade08ffac5c0ef2 has been approved by epage
It is now in the queue for this repository.

:hourglass: Testing commit 4db4a13662f62e6ae3c2ee59cade08ffac5c0ef2 with merge 47860645b493258a113aa465f362cd9e343960d4...

:sunny: Test successful - checks-actions
Approved by: epage
Pushing 47860645b493258a113aa465f362cd9e343960d4 to master...


App is currently not Python 3 compatible

Name of the app
Proofpoint
Describe the bug
App is currently not Python 3 compatible
To Reproduce
Error when installing in SOAR Cloud
Expected behavior
Should be installed without issues
Splunk SOAR Version (please complete the following information):

App Version: 1.2.22

Additional context
New build compatible with Python 3 was created (fork link) but not yet tested. Awaiting for test/customer environment.

I am downloading and will implement in the next few weeks and return with feedback.

The fork linked package fails to install with the error:
'proofpoint.json' failed validation on value 'main_module'

This seems to have been fixed.


Add links to execution policy modification to the readme

Many users will probably get the error that the ps1 isn't digitally signed (unless they've already relaxed their execution policy).  It would be a good idea to have a section outlining how to change that (and the repercussions of doing so) in the readme.

Does this not accomplish that for you?
Powershell.exe -ExecutionPolicy Bypass -File .\install_folding_sandbox_on_host.ps1
Seems to work fine for me, but if it doesn't for you let me know. The 'Running the Sample' section of the README in the folding directory describes this.

Yep, that works.  Sorry, must have skimmed over that line.


KL during Training

I don't know why KL is always 0 during training, does anyone have this problem?

Many issues with my KL value were resolved by setting the generation arguments. Check this thread.
Add warning when KL-divergence is negative · Issue #235 · huggingface/trl (github.com)

In addition to what @sakinafatima said, if the KL is strictly zero it means that the active and reference model are identical and so your active model is not learning anything.


How does the restApiCall component add HTTP basic authentication credentials?

Place the authentication information into the Authorization header, configured like this.
 {
  "id": "s1",
  "type": "restApiCall",
  "name": "call api",
  "configuration": {
    "restEndpointUrlPattern": "http://xxx:9099/api/msg",
    "requestMethod": "POST",
    "headers": {
       “Authorization”:"Basic your_username:your_password"
      }
  }
}

Place the authentication information into the Authorization header, configured like this.
 {
  "id": "s1",
  "type": "restApiCall",
  "name": "call api",
  "configuration": {
    "restEndpointUrlPattern": "http://xxx:9099/api/msg",
    "requestMethod": "POST",
    "headers": {
       “Authorization”:"Basic your_username:your_password"
      }
  }
}

Okay, thanks, I don't need to change the source code like it


fix: autoscaler: Drop control script

Description
This drops the BOSH-style control script for the autoscaler golang apiserver, and uses BPM to directly launch the binary.
I suspect I may be missing features in that control script that the IBM folks are using; however GitHub doesn't seem to like me. @aqan213 — would you have some time to take a look?
Motivation and Context
I suspect that the control script (having been designed for monit) uses a PID file, which doesn't work well when the container restarts.  I'm seeing issues on some deployments (on CI) where that pod gets stuck at an unready state (crashing repeatedly); deleting the pod and letting the deployment spin up a new one works around the issue.
How Has This Been Tested?
This was cherry-picked out of my branch related to GitHub Actions work for #1144; I haven't had issues related to the autoscaler not being ready since I made the change.
Types of changes

[x] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

[ ] My code has security implications.
[ ] My code follows the code style of this project.
[ ] My change requires a change to the documentation.
[ ] I have updated the documentation accordingly.

@mook-as The ctl script supports pre/post start/stop hooks.

@andreas-kupries Yes, but as far as I can tell we don't actually use that capability.

Yes. Thus the question to @aqan213 if IBM does, right ?

@mook-as @andreas-kupries  Since autoscaler does not support bpm for now(it supports monit). We need to migrate to bpm(refer to https://bosh.io/docs/bpm/transitioning/#converting-_ctl-scripts-to-bpmyml). We actually use the start command only in kubecf and can modify it just like Mark does.
- name: golangapiserver
  executable: /var/vcap/packages/golangapiserver/api
  args:
  - -c
  - /var/vcap/jobs/golangapiserver/config/apiserver.yml

Thanks for the answer!
Okay, sounds like it should be okay to merge this then? r?@andreas-kupries then :)


Test: search provider API

Test for #47058
Complexity: 2

[ ] AnyOS @chrmarti

Steps:

Write a simple extension that uses the SearchProvider API. See an example at https://github.com/Microsoft/vscode-extension-samples/blob/roblou/searchProviderExample/fsprovider-sample/src/searchProvider.ts
File issues if you have any issues getting results to show up, or if any part of the API itself is confusing.

@roblourens I can't get it to work with todays insiders build and also tried MemFS. The search provider is never called.

That makes it work. 👍


Fixed floating conversion

Fixed ESP8266 float --> int conversion.

Thanks, I don't know when/how this snuck back in. Probably during the API rework, there was a lot of copy-pasting. I will release this as v2.0.1.


Integrating trajdata into trajectron++

Hi,
currently I'm trying to integrate trajdata into T++. I started with the simplest approach of not touching T++ code at all and basically rewrite the dataset specific preprocessing code such as this and use trajdata for it.
While this works (at least with the simple eth dataset without maps, I haven't implemented nuscenes yet) I don't like the approach very much as it is basically only converting from one data format to the other and none of the features of trajdata are really used.
Instead I would like to integrate trajdata more deeply into T++ using it directly with pytorch Dataloader. This is probably what you're doing as well.
My thoughts on how to this would be the following:

Trajdata replaces EnvironmentDataset, NodeTypeDataset as well as the internal data structures like Scene and Node completely
Construct Datasets for each Agent type and load them with the pytorch dataloader
Modify the batch processing code (https://github.com/StanfordASL/Trajectron-plus-plus/blob/ef0165a93ee5ba8cdc14f9b999b3e00070cd8588/trajectron/model/trajectron.py#L67) to use the new data format instead

Hope this makes sense. There are a few issues though:

The previous code of NodeTypeDataset multiplies some scenes and nodes. Is this still necessary with trajdata? How would I do this
How do I work with the temporal scene graph with trajdata? T++ uses such a graph for the edge encoding (https://github.com/StanfordASL/Trajectron-plus-plus/blob/58b9763d02b9c90e1b67dad1026bf0b1b9e322a9/trajectron/model/dataset/preprocessing.py#L115). Trajdata offers something similar with agent_interaction_distances, which doesn't support hyperparameters like edge_addition_filter and edge_removal_filter though.

Thanks for your help!
It would be super helpful to see your work in progress implementation of trajdata in Trajectron. This would probably resolve my questions and speed up my development. If you company rules allow you to share this, I would be very grateful.
(Uploaded as a git patch here for example)

Hi @Leon0402, my apologies for the delay in responding (I'll also make sure to respond to your other issues soon)!
Indeed, I plan to release an updated Trajectron++ codebase that uses the dataloader. Unfortunately, I'll have to wait until after my next paper deadline since I'm using T++ with the dataloader in that work and will have to go through the proper IP review channels before releasing it (as you guessed).
Having said that, everything you said above is correct. Let me answer the questions you have outstanding:

The previous code of NodeTypeDataset multiplies some scenes and nodes. Is this still necessary with trajdata? How would I do this?

Good question, I personally just did away with that multiplying (it was an attempt to fix the crazy imbalance in the data, where straight-line driving dominates) and found that the model still performs fine. Admittedly, I don't have concrete evaluation numbers just yet, but I'll get them soon and then we'll see if I'm totally wrong about that or not.
More broadly, I haven't implemented a dataset sample weighting scheme yet (likely I would just use the weighted sampling schemes offered by PyTorch anyways), but maybe PyTorch's own sample weighting capabilities would be a good place to start looking if you want to have that for your model.

How do I work with the temporal scene graph with trajdata? T++ uses such a graph for the edge encoding (https://github.com/StanfordASL/Trajectron-plus-plus/blob/58b9763d02b9c90e1b67dad1026bf0b1b9e322a9/trajectron/model/dataset/preprocessing.py#L115). Trajdata offers something similar with agent_interaction_distances, which doesn't support hyperparameters like edge_addition_filter and edge_removal_filter though.

I completely don't use the temporal scene graph anymore, instead I directly use the hyperparams['edge_addition_filter'] in the edge encoder in mgcvae.py


Townsend snow

[x] Closes #1246
[ ] I am familiar with the contributing guidelines
[x] Tests added
[ ] Updates entries to docs/sphinx/source/api.rst for API changes.
[ ] Adds description and name entries in the appropriate "what's new" file in docs/sphinx/source/whatsnew for all changes. Includes link to the GitHub Issue with :issue:`num` or this Pull Request with :pull:`num`. Includes contributor name and/or GitHub username (link with :ghuser:`user`).
[x] New code is fully documented. Includes numpydoc compliant docstrings, examples, and comments where necessary.
[ ] Pull request is nearly complete and ready for detailed review.
[x] Maintainer: Appropriate GitHub Labels and Milestone are assigned to the Pull Request and linked Issue.

Excuse me for the long delay! I will be working on resolving the issues of this PR in the coming couple of days.

Superseded by #1468


feat: html output, web front end

Summary:
Features

Create an html report in the same folder as the json report when run via command line.
Add an embedded web server which can be run via a  --web_server option.

Build

Use spotless to check java syntax instead of com.github.sherter.google-java-format which appears to be unmaintained.
Fix various small gradle warnings.
Added a build.gradle task to compile js libraries, and bundle web front end assets to java source code.

Expected behavior:

Command line validation writes a report.html file in the output directory, the file name can be chosen by  --validation_html_report_name.

--web_server will run an embedded web server on port 6888, where one can submit GTFS files for validation.

./gradlew generateViewerAssets will re-generate ViewerAssets.java based on source html, js, and css. There might be better ways to achieve this, I'm not very familiar with best practices for java bundling or code generation. UPDATE: I've added a dependency from build to the js compilation and bundling steps. I think this is how gradle is supposed to work but I'd love a review from someone who is knowledgeable. See main/build.gradle.

Please make sure these boxes are checked before submitting your pull request - thanks!

[x] Run the unit tests with gradle test to make sure you didn't break anything
[x] Format the title like "feat: [new feature short description]". Title must follow the Conventional Commit Specification(https://www.conventionalcommits.org/en/v1.0.0/).
[x] Linked all relevant issues

https://github.com/MobilityData/gtfs-validator/issues/495

[ ] Include screenshot(s) showing how this pull request works and fixes the issue(s)

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.1 out of 2 committers have signed the CLA.:white_check_mark: ed-g:x: lisaattrilliumYou have signed the CLA already but the status is still pending? Let us recheck it.

a much needed feature to expand access to the validator beyond consuming software applications! Producers have relied on the quite stale feedvalidator.py script from the transitfeeds library of scripts and not having a human-readable out for this validator has hindered adoption.

Hello, thank you so much for this contribution @ed-g!
This is indeed one of the top requested features for this tool :)
One question: what is the reason you chose Spark Java?
Not sure if you were aware, we previously started to work on an Interface using Spring Boot (in PR#421).

Hello @isabelle-dr! You're very welcome :-)
My coworker and I took a look for the previous web ui, based on this comment, https://github.com/MobilityData/gtfs-validator/issues/445#issuecomment-764779942 and https://github.com/MobilityData/gtfs-validator/issues/495#issuecomment-749597294 we got the sense that 2.0 updates may have changed some internals that it relied upon?
There is no particular reason why I chose spark java over spring boot or another web framework. I think it could be ported to pretty much anything if the team has another preference.

I've added some basic Jasmine tests and merged report text and css updates.
Our current project funding ends today, please don't be shy if you have any quick requests for improvements.

Can anyone share a brief snapshot on where this is on getting merged? Are there blockers?

Closing this PR, since this will not be worked on further


Close side menu on article selection

In both mobile and tables views, the side menu should automatically close when a new article is selected.

Can I take this up?

@imbhargav5 feel free :]

This issue can now be closed.


Top-level reference section

Opening for discussion. We recently finished moving all the remote info from the command reference to distinct user guides. I think it's way more organized now, but I worry that it's too deeply nested inside user-guide->data-management->remote storage.
We know that this is some of the most frequently visited info, and so is user-guide->project structure->dvc.yaml files. Can we create a top-level reference section that includes remotes, project structure, CLI, and Python references? I think it would help make these pages easier to find and create a cleaner separation between more narrative guides and technical reference material.
Proposed structure would look like:

User guide

Data management
Pipelines
Experiment management
...

Reference

Project structure
Remote config
Commands
Python API

Sounds good to me, @dberenbaum !

Project structure should become more like a Project file or something? I don't like this name, but can't come up with something better ... dvc.yaml reference?
Remote config - I wonder if we should do one Config reference - include remotes there (w/o additional level, all things about remotes and config on the same level).

Project structure should become more like a Project file or something? I don't like this name, but can't come up with something better ... dvc.yaml reference?

Agreed, I think we need to make it better than project structure, which sounds more like we are giving suggestions on how to organize your project. Right now, it includes more than dvc.yaml but also any other DVC-managed files.

Remote config - I wonder if we should do one Config reference - include remotes there (w/o additional level, all things about remotes and config on the same level).

Makes sense. Would we want subpages for each remote like we now have in the guide? Then it becomes as nested as it is now, so now I'm second guessing this 😅 .

I think we can keep it:
Reference
   Config
       SSH
       Google Drive
       ...
       Cache
       [Other config ....]

wdyt?

It could work, or it might be too busy.
Let's put this as a p2 for now. We have already moved this info around a lot. I'd rather focus on get started and new content focused on basic workflows than on moving around the existing content.

Another benefit would be to have somewhere to mention environment variables

Bumping the importance here but also want to consider other changes to consolidate the dvc/mlops docs (dvc, dvclive, studio, vs code)

Prioritizing Integrations
Integrations is a section with its own importance in docs in B , thing that has proven important when including a tool in a fast-track scenario. In DVC, I have to go to DVCLive > ML Frameworks
𝙲𝙾𝙽𝙲𝙻𝚄𝚂𝙸𝙾𝙽: 𝚝𝚑𝚎 𝚌𝚘𝚗𝚝𝚛𝚒𝚋𝚞𝚝𝚘𝚛 𝚛𝚎𝚌𝚘𝚖𝚖𝚎𝚗𝚍𝚜 𝚝𝚘 𝚝𝚑𝚎 𝚖𝚊𝚒𝚗𝚝𝚊𝚒𝚗𝚎𝚛 𝚝𝚘 𝚛𝚎𝚌𝚘𝚐𝚗𝚒𝚣𝚎 𝚒𝚗𝚝𝚎𝚐𝚛𝚊𝚝𝚒𝚘𝚗𝚜 𝚊𝚜 𝚙𝚊𝚛𝚝 𝚘𝚏 𝚝𝚑𝚎 𝚏𝚊𝚜𝚝-𝚝𝚛𝚊𝚌𝚔 𝚜𝚌𝚎𝚗𝚊𝚛𝚒𝚘, 𝚊𝚗𝚍 𝚙𝚛𝚒𝚘𝚛𝚒𝚝𝚒𝚣𝚎 𝚊𝚌𝚌𝚎𝚜𝚜 𝚊𝚌𝚌𝚘𝚛𝚍𝚒𝚗𝚐𝚕𝚢.

Originally posted by @SoyGema in https://github.com/iterative/dvc.org/issues/4919#issuecomment-1762823346
Consider moving integration to a top-level section if we do this reorg

Combining with the ideas in https://github.com/iterative/dvc.org/issues/5153, we can use this ticket to discuss the overall structure of the docs. Here's a proposal of an ideal state to work towards:

Get started

Data pipelines
Experiment tracking
Model registry

Use cases (still not sure where to put these; should they be outside docs? before get started?)

Versioning data and models
CI/CD for machine learning (generalize beyond CI/CD to automated ML workflows? update to reference studio cloud compute?)
Fast and secure data caching hub (analytics show its unpopular; drop/rename/replace in the future with use case about using studio for secure data access?)
Experiment tracking
Model registry
Data registry

User guide

Data
Pipelines
Experiments
Models

Reference

Studio UI
Studio REST API
DVC Configuration
DVC Commands
DVC Python API
DVCLive Python API
GTO Commands


[Site] Add the Navbar section

Desired State of the Service Mesh Patterns site

A NavBar section needs to be added to the site as per this Figma design.

Contributor Resources
This website uses React and GitHub Pages. Site content is found under the master branch.

See the Contributing to Service Mesh Patterns Website section of the readme.md and other contributing instructions, too.
Layer5 Brand Kit
📑 Service Mesh Patterns in Meshery Catalog
📖 Service Mesh Patterns Book
🎨 Site designs in Figma. Fill-in the Layer5 Community Member Form and join the Layer5 Community Slack for access.
🙋🏾🙋🏼 Questions: Discussion Forum and Community Slack

I would love to work on this issue, Can I take this up @Nikhil-Ladha :)

Sure, and hopefully on Monday's website call we will be having a demo by you :)

@Palaksharma23 any progress over the navbar ? If yes kindly submit a PR.
@Nikhil-Ladha Please assign me I will take it over from here.

yes she has told me to do so on slack as she is busy with exams.
though I will wait to get a ans of the progress from her .

Ok, then get's over with this.


Actions: use commit graph for version comparisons

Convert tags and branches to commit hash, then, to compare, BFS graph until match found if the comparison operator isn't equals.
Notes about error handling:

Require rules are skipped on error as before (eg. if version comparison ">= v3.0.1" used but there is no v3.0.1 tag)
Deny rules are skipped on error as before (eg. if version comparison "<= v2.3.0" used but there is no v2.3.0 tag)

"v2.3.0" isn't considered equivalent to "2.3.0" beginning with this PR because tags are mapped to commits for comparison

Add option qualifyUntaggedCommits for allow / require rule?

Going to close this as we haven't made a decision on this in a few years.
Thanks for raising this contribution though, @ethanent!


why use FLTK GUI library?

I ask this because the interface is not very pleasing to the eye because it is old, but I understand that one of the reasons was because it is light, but I think the project would benefit from a more modern GUI and since you rewrote a lot of the code in C++ maybe this would be the right time to change, maybe QT which is made in C++, GTK or Iced if you still intend to leave the GUI in Rust
Since you prefer C++, I think it would be better to keep the code in just one language to attract more contributions

I'm not sure if this is related but i'm using kubuntu with an nivdia card and when i am running gameimage the mouse becomes stuttery definitely not smooth as soon as i close gameimage the mouse is fine. Also any chance the logger windows can use larger fonts? They look tiny and also jaggy

Wayland support is now enabled for fltk-rs, with should mitigate issues that were present in  Xwayland. Now scaling (wayland) is working properly on both launcher and wizard.